| Column Name | Column Data Type |
|---|
cluster_id Required Input Column
The identifier of the cluster with steps to describe. | VARCHAR |
step_id Required Input Column
The identifier of the step to describe. | VARCHAR |
_aws_profile Input Column
The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role. | STRUCT(
"type" VARCHAR,
"name" VARCHAR,
"account_id" VARCHAR,
"via_profile_name" VARCHAR,
"assumed_role_arn" VARCHAR,
"organization" STRUCT(
"account_name" VARCHAR,
"id" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[],
"master_account" STRUCT(
"id" VARCHAR,
"email" VARCHAR
),
"parents" STRUCT(
"type" VARCHAR,
"id" VARCHAR,
"name" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[]
)[]
)
) |
Show child fields- _aws_profile.account_id
The AWS account id - _aws_profile.assumed_role_arn
The ARN of the assumed role - _aws_profile.name
The unique name of the profile. - _aws_profile.organization
Information about this profile's membership in the AWS organization. Show child fields- _aws_profile.organization.account_name
The name of account speciifed by the organization - _aws_profile.organization.id
The organization id - _aws_profile.organization.master_account
Show child fields- _aws_profile.organization.master_account.email
The organization master account email address - _aws_profile.organization.master_account.id
The organization master account id
- _aws_profile.organization.parents[]
Show child fields- _aws_profile.organization.parents[].id
The id of the parent - _aws_profile.organization.parents[].name
The name of the parent - _aws_profile.organization.parents[].tags[]
Show child fields- _aws_profile.organization.parents[].tags[].key
- _aws_profile.organization.parents[].tags[].value
- _aws_profile.organization.parents[].type
The type of parent can be an organization unit or a root
- _aws_profile.organization.tags[]
Show child fields- _aws_profile.organization.tags[].key
- _aws_profile.organization.tags[].value
- _aws_profile.type
The type of profile, either 'credentials' or 'assumed_role' - _aws_profile.via_profile_name
This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.
|
step
The step details for the requested step identifier. | STRUCT(
"id" VARCHAR,
"name" VARCHAR,
"config" STRUCT(
"jar" VARCHAR,
"properties" MAP(VARCHAR, VARCHAR),
"main_class" VARCHAR,
"args" VARCHAR[]
),
"action_on_failure" VARCHAR,
"status" STRUCT(
"state" VARCHAR,
"state_change_reason" STRUCT(
"code" VARCHAR,
"message" VARCHAR
),
"failure_details" STRUCT(
"reason" VARCHAR,
"message" VARCHAR,
"log_file" VARCHAR
),
"timeline" STRUCT(
"creation_date_time" TIMESTAMP_S,
"start_date_time" TIMESTAMP_S,
"end_date_time" TIMESTAMP_S
)
),
"execution_role_arn" VARCHAR
) |
Show child fields- step.action_on_failure
The action to take when the cluster step fails. Possible values are TERMINATE_CLUSTER, CANCEL_AND_WAIT, and CONTINUE. TERMINATE_JOB_FLOW is provided for backward compatibility. We recommend using TERMINATE_CLUSTER instead. If a cluster's StepConcurrencyLevel is greater than 1, do not use AddJobFlowSteps to submit a step with this parameter set to CANCEL_AND_WAIT or TERMINATE_CLUSTER. The step is not submitted and the action fails with a message that the ActionOnFailure setting is not valid. If you change a cluster's StepConcurrencyLevel to be greater than 1 while a step is running, the ActionOnFailure parameter may not behave as you expect. In this case, for a step that fails with this parameter set to CANCEL_AND_WAIT, pending steps and the running step are not canceled; for a step that fails with this parameter set to TERMINATE_CLUSTER, the cluster does not terminate. - step.config
The Hadoop job configuration of the cluster step. Show child fields- step.config.args[]
- step.config.jar
The path to the JAR file that runs during the step. - step.config.main_class
The name of the main class in the specified Java file. If not specified, the JAR file should specify a main class in its manifest file. - step.config.properties
The list of Java properties that are set when the step runs. You can use these properties to pass key-value pairs to your main function.
- step.execution_role_arn
The Amazon Resource Name (ARN) of the runtime role for a step on the cluster. The runtime role can be a cross-account IAM role. The runtime role ARN is a combination of account ID, role name, and role type using the following format: arn:partition:service:region:account:resource. For example, arn:aws:IAM::1234567890:role/ReadOnly is a correctly formatted runtime role ARN. - step.id
The identifier of the cluster step. - step.name
The name of the cluster step. - step.status
The current execution status details of the cluster step. Show child fields- step.status.failure_details
The details for the step failure including reason, message, and log file path where the root cause was identified. Show child fields- step.status.failure_details.log_file
The path to the log file where the step failure root cause was originally recorded. - step.status.failure_details.message
The descriptive message including the error the Amazon EMR service has identified as the cause of step failure. This is text from an error log that describes the root cause of the failure. - step.status.failure_details.reason
The reason for the step failure. In the case where the service cannot successfully determine the root cause of the failure, it returns "Unknown Error" as a reason.
- step.status.state
The execution state of the cluster step. - step.status.state_change_reason
The reason for the step execution status change. Show child fields- step.status.state_change_reason.code
The programmable code for the state change reason. Note: Currently, the service provides no code for the state change. - step.status.state_change_reason.message
The descriptive message for the state change reason.
- step.status.timeline
The timeline of the cluster step status over time. Show child fields- step.status.timeline.creation_date_time
The date and time when the cluster step was created. - step.status.timeline.end_date_time
The date and time when the cluster step execution completed or failed. - step.status.timeline.start_date_time
The date and time when the cluster step execution started.
|