Skip to content

Commit 00ee60e

Browse files
author
AWS
committed
Amazon EMR Update: Add support for customers to modify cluster attribute auto-terminate post cluster launch
1 parent 42fa384 commit 00ee60e

File tree

2 files changed

+35
-0
lines changed

2 files changed

+35
-0
lines changed
Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
{
2+
"type": "feature",
3+
"category": "Amazon EMR",
4+
"contributor": "",
5+
"description": "Add support for customers to modify cluster attribute auto-terminate post cluster launch"
6+
}

services/emr/src/main/resources/codegen-resources/service-2.json

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -630,6 +630,18 @@
630630
],
631631
"documentation":"<p>RunJobFlow creates and starts running a new cluster (job flow). The cluster runs the steps specified. After the steps complete, the cluster stops and the HDFS partition is lost. To prevent loss of data, configure the last step of the job flow to store results in Amazon S3. If the <a>JobFlowInstancesConfig</a> <code>KeepJobFlowAliveWhenNoSteps</code> parameter is set to <code>TRUE</code>, the cluster transitions to the WAITING state rather than shutting down after the steps have completed. </p> <p>For additional protection, you can set the <a>JobFlowInstancesConfig</a> <code>TerminationProtected</code> parameter to <code>TRUE</code> to lock the cluster and prevent it from being terminated by API call, user intervention, or in the event of a job flow error.</p> <p>A maximum of 256 steps are allowed in each job flow.</p> <p>If your cluster is long-running (such as a Hive data warehouse) or complex, you may require more than 256 steps to process your data. You can bypass the 256-step limitation in various ways, including using the SSH shell to connect to the master node and submitting queries directly to the software running on the master node, such as Hive and Hadoop.</p> <p>For long-running clusters, we recommend that you periodically store your results.</p> <note> <p>The instance fleets configuration is available only in Amazon EMR releases 4.8.0 and later, excluding 5.0.x versions. The RunJobFlow request can contain InstanceFleets parameters or InstanceGroups parameters, but not both.</p> </note>"
632632
},
633+
"SetKeepJobFlowAliveWhenNoSteps":{
634+
"name":"SetKeepJobFlowAliveWhenNoSteps",
635+
"http":{
636+
"method":"POST",
637+
"requestUri":"/"
638+
},
639+
"input":{"shape":"SetKeepJobFlowAliveWhenNoStepsInput"},
640+
"errors":[
641+
{"shape":"InternalServerError"}
642+
],
643+
"documentation":"<p>You can use the <code>SetKeepJobFlowAliveWhenNoSteps</code> to configure a cluster (job flow) to terminate after the step execution, i.e., all your steps are executed. If you want a transient cluster that shuts down after the last of the current executing steps are completed, you can configure <code>SetKeepJobFlowAliveWhenNoSteps</code> to false. If you want a long running cluster, configure <code>SetKeepJobFlowAliveWhenNoSteps</code> to true.</p> <p>For more information, see <a href=\"https://docs.aws.amazon.com/emr/latest/ManagementGuide/UsingEMR_TerminationProtection.html\">Managing Cluster Termination</a> in the <i>Amazon EMR Management Guide</i>.</p>"
644+
},
633645
"SetTerminationProtection":{
634646
"name":"SetTerminationProtection",
635647
"http":{
@@ -4848,6 +4860,23 @@
48484860
"type":"list",
48494861
"member":{"shape":"SessionMappingSummary"}
48504862
},
4863+
"SetKeepJobFlowAliveWhenNoStepsInput":{
4864+
"type":"structure",
4865+
"required":[
4866+
"JobFlowIds",
4867+
"KeepJobFlowAliveWhenNoSteps"
4868+
],
4869+
"members":{
4870+
"JobFlowIds":{
4871+
"shape":"XmlStringList",
4872+
"documentation":"<p>A list of strings that uniquely identify the clusters to protect. This identifier is returned by <a href=\"https://docs.aws.amazon.com/emr/latest/APIReference/API_RunJobFlow.html\">RunJobFlow</a> and can also be obtained from <a href=\"https://docs.aws.amazon.com/emr/latest/APIReference/API_DescribeJobFlows.html\">DescribeJobFlows</a>.</p>"
4873+
},
4874+
"KeepJobFlowAliveWhenNoSteps":{
4875+
"shape":"Boolean",
4876+
"documentation":"<p>A Boolean that indicates whether to terminate the cluster after all steps are executed.</p>"
4877+
}
4878+
}
4879+
},
48514880
"SetTerminationProtectionInput":{
48524881
"type":"structure",
48534882
"required":[

0 commit comments

Comments
 (0)