A company is planning on using the EMR service for their Big data processing needs.
They currently want to experiment with the service and create transient cluster to carry out various data processing jobs.
Which of the following would help effectively ensure the clusters are transient in nature? Choose 2 possible answers from the options given below.
Each answer is an independent and complete solution.
Click on the arrows to vote for the correct answer
A. B. C. D.Answer - A and C.
The AWS Documentation mentions the following.
By default, clusters that you create using the console or the AWS CLI continue to run until you shut them down.
To have a cluster terminate after running steps, you need to enable auto-termination.
In contrast, clusters that you launch using the EMR API have auto-termination enabled by default.
Since the documentation clearly mentions this, all other options are invalid.
For more information on planning for cluster deployment, please refer to the below URL.
https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-longrunning-transient.htmlTo create a transient cluster in Amazon EMR, two possible solutions are:
Explanation:
Create the cluster using the AWS CLI: The AWS CLI (Command Line Interface) is a powerful tool for managing AWS resources. It allows you to create and manage EMR clusters from the command line, which makes it easy to automate the creation and management of transient clusters. When you create an EMR cluster using the CLI, you can specify options such as instance type, number of instances, and auto-termination time. By setting an auto-termination time, you can ensure that the cluster will automatically terminate after a specified period of inactivity, thus making it transient in nature.
Ensure the cluster has auto-termination enabled: When you create a cluster in Amazon EMR, you can enable auto-termination to ensure that the cluster terminates automatically after a specified period of inactivity. This is an important feature for creating transient clusters because it ensures that the cluster will be terminated when it's no longer needed, which can help reduce costs. By default, auto-termination is disabled in Amazon EMR. To enable it, you can specify the "--auto-terminate" option when creating the cluster or you can enable it in the cluster configuration.
Therefore, creating the cluster using the AWS CLI and enabling auto-termination are both effective ways to ensure that the EMR clusters are transient in nature.