Skip to content

aws.emr.list_clusters

Example SQL Queries

SELECT * FROM
aws.emr.list_clusters;

Description

Provides the status of all clusters visible to this Amazon Web Services account. Allows you to filter the list of clusters based on certain criteria; for example, filtering by cluster creation date and time or by status. This call returns a maximum of 50 clusters in unsorted order per call, but returns a marker to track the paging of the cluster list across multiple ListClusters calls.

Table Definition

Column NameColumn Data Type
cluster_states Input Column

The cluster state filters to apply when listing clusters. Clusters that change state while this action runs may be not be returned as expected in the list of clusters.

VARCHAR[]
Show child fields
cluster_states[]
created_after Input Column

The creation date and time beginning value filter for listing clusters.

TIMESTAMP_S
created_before Input Column

The creation date and time end value filter for listing clusters.

TIMESTAMP_S
_aws_profile Input Column

The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role.

STRUCT(
"type" VARCHAR,
"name" VARCHAR,
"account_id" VARCHAR,
"via_profile_name" VARCHAR,
"assumed_role_arn" VARCHAR,
"organization" STRUCT(
"account_name" VARCHAR,
"id" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[],
"master_account" STRUCT(
"id" VARCHAR,
"email" VARCHAR
),
"parents" STRUCT(
"type" VARCHAR,
"id" VARCHAR,
"name" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[]
)[]
)
)
Show child fields
_aws_profile.account_id

The AWS account id

_aws_profile.assumed_role_arn

The ARN of the assumed role

_aws_profile.name

The unique name of the profile.

_aws_profile.organization

Information about this profile's membership in the AWS organization.

Show child fields
_aws_profile.organization.account_name

The name of account speciifed by the organization

_aws_profile.organization.id

The organization id

_aws_profile.organization.master_account
Show child fields
_aws_profile.organization.master_account.email

The organization master account email address

_aws_profile.organization.master_account.id

The organization master account id

_aws_profile.organization.parents[]
Show child fields
_aws_profile.organization.parents[].id

The id of the parent

_aws_profile.organization.parents[].name

The name of the parent

_aws_profile.organization.parents[].tags[]
Show child fields
_aws_profile.organization.parents[].tags[].key
_aws_profile.organization.parents[].tags[].value
_aws_profile.organization.parents[].type

The type of parent can be an organization unit or a root

_aws_profile.organization.tags[]
Show child fields
_aws_profile.organization.tags[].key
_aws_profile.organization.tags[].value
_aws_profile.type

The type of profile, either 'credentials' or 'assumed_role'

_aws_profile.via_profile_name

This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.

cluster_arn

The Amazon Resource Name of the cluster.

VARCHAR
id

The unique identifier for the cluster.

VARCHAR
name

The name of the cluster.

VARCHAR
normalized_instance_hours

An approximation of the cost of the cluster, represented in m1.small/hours. This value is incremented one time for every hour an m1.small instance runs. Larger instances are weighted more, so an Amazon EC2 instance that is roughly four times more expensive would result in the normalized instance hours being incremented by four. This result is only an approximation and does not reflect the actual billing rate.

BIGINT
outpost_arn

The Amazon Resource Name (ARN) of the Outpost where the cluster is launched.

VARCHAR
status

The details about the current status of the cluster.

STRUCT(
"state" VARCHAR,
"state_change_reason" STRUCT(
"code" VARCHAR,
"message" VARCHAR
),
"timeline" STRUCT(
"creation_date_time" TIMESTAMP_S,
"ready_date_time" TIMESTAMP_S,
"end_date_time" TIMESTAMP_S
),
"error_details" STRUCT(
"error_code" VARCHAR,
"error_data" MAP(VARCHAR, VARCHAR)[],
"error_message" VARCHAR
)[]
)
Show child fields
status.error_details[]
Show child fields
status.error_details[].error_code

The name or code associated with the error.

status.error_details[].error_data[]
status.error_details[].error_message

A message that describes the error.

status.state

The current state of the cluster.

status.state_change_reason

The reason for the cluster status change.

Show child fields
status.state_change_reason.code

The programmatic code for the state change reason.

status.state_change_reason.message

The descriptive message for the state change reason.

status.timeline

A timeline that represents the status of a cluster over the lifetime of the cluster.

Show child fields
status.timeline.creation_date_time

The creation date and time of the cluster.

status.timeline.end_date_time

The date and time when the cluster was terminated.

status.timeline.ready_date_time

The date and time when the cluster was ready to run steps.