Skip to content
AWS for Query.Farm

aws.emr_containers.describe_job_run

Example SQL Queries

SELECT * FROM
aws.emr_containers.describe_job_run
WHERE
"id" = 'VALUE'
AND "virtual_cluster_id" = 'VALUE';

Description

Displays detailed information about a job run. A job run is a unit of work, such as a Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon EMR on EKS.

Table Definition

Column NameColumn Data Type
id Required Input Column

The ID of the job run request. 

VARCHAR
virtual_cluster_id Required Input Column

The ID of the virtual cluster for which the job run is submitted.

VARCHAR
_aws_profile Input Column

The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role.

STRUCT(
    "type" VARCHAR,
    "name" VARCHAR,
    "account_id" VARCHAR,
    "via_profile_name" VARCHAR,
    "assumed_role_arn" VARCHAR,
    "organization" STRUCT(
        "account_name" VARCHAR,
        "id" VARCHAR,
        "tags" STRUCT(
            "key" VARCHAR,
            "value" VARCHAR
        )[],
        "master_account" STRUCT(
            "id" VARCHAR,
            "email" VARCHAR
        ),
        "parents" STRUCT(
            "type" VARCHAR,
            "id" VARCHAR,
            "name" VARCHAR,
            "tags" STRUCT(
                "key" VARCHAR,
                "value" VARCHAR
            )[]
        )[]
    )
)
Show child fields
_aws_profile.account_id

The AWS account id

_aws_profile.assumed_role_arn

The ARN of the assumed role

_aws_profile.name

The unique name of the profile.

_aws_profile.organization

Information about this profile's membership in the AWS organization.

Show child fields
_aws_profile.organization.account_name

The name of account speciifed by the organization

_aws_profile.organization.id

The organization id

_aws_profile.organization.master_account
Show child fields
_aws_profile.organization.master_account.email

The organization master account email address

_aws_profile.organization.master_account.id

The organization master account id

_aws_profile.organization.parents[]
Show child fields
_aws_profile.organization.parents[].id

The id of the parent

_aws_profile.organization.parents[].name

The name of the parent

_aws_profile.organization.parents[].tags[]
Show child fields
_aws_profile.organization.parents[].tags[].key
_aws_profile.organization.parents[].tags[].value
_aws_profile.organization.parents[].type

The type of parent can be an organization unit or a root

_aws_profile.organization.tags[]
Show child fields
_aws_profile.organization.tags[].key
_aws_profile.organization.tags[].value
_aws_profile.type

The type of profile, either 'credentials' or 'assumed_role'

_aws_profile.via_profile_name

This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.

_aws_region Input Column

The AWS region to use.

VARCHAR
job_run

The output displays information about a job run.

STRUCT(
    "id" VARCHAR,
    "name" VARCHAR,
    "virtual_cluster_id" VARCHAR,
    "arn" VARCHAR,
    "state" VARCHAR,
    "client_token" VARCHAR,
    "execution_role_arn" VARCHAR,
    "release_label" VARCHAR,
    "configuration_overrides" STRUCT(
        "application_configuration" STRUCT(
            "classification" VARCHAR,
            "properties" MAP(VARCHAR, VARCHAR)
        )[],
        "monitoring_configuration" STRUCT(
            "persistent_app_ui" VARCHAR,
            "cloud_watch_monitoring_configuration" STRUCT(
                "log_group_name" VARCHAR,
                "log_stream_name_prefix" VARCHAR
            ),
            "s3_monitoring_configuration" STRUCT(
                "log_uri" VARCHAR
            ),
            "container_log_rotation_configuration" STRUCT(
                "rotation_size" VARCHAR,
                "max_files_to_keep" BIGINT
            )
        )
    ),
    "job_driver" STRUCT(
        "spark_submit_job_driver" STRUCT(
            "entry_point" VARCHAR,
            "entry_point_arguments" VARCHAR[],
            "spark_submit_parameters" VARCHAR
        ),
        "spark_sql_job_driver" STRUCT(
            "entry_point" VARCHAR,
            "spark_sql_parameters" VARCHAR
        )
    ),
    "created_at" TIMESTAMP_S,
    "created_by" VARCHAR,
    "finished_at" TIMESTAMP_S,
    "state_details" VARCHAR,
    "failure_reason" VARCHAR,
    "tags" MAP(VARCHAR, VARCHAR),
    "retry_policy_configuration" STRUCT(
        "max_attempts" BIGINT
    ),
    "retry_policy_execution" STRUCT(
        "current_attempt_count" BIGINT
    )
)
Show child fields
job_run.arn

The ARN of job run.

job_run.client_token

The client token used to start a job run.

job_run.configuration_overrides

The configuration settings that are used to override default configuration.

Show child fields
job_run.configuration_overrides.application_configuration[]
Show child fields
job_run.configuration_overrides.application_configuration[].classification

The classification within a configuration.

job_run.configuration_overrides.application_configuration[].properties

A set of properties specified within a configuration classification.

job_run.configuration_overrides.monitoring_configuration

The configurations for monitoring.

Show child fields
job_run.configuration_overrides.monitoring_configuration.cloud_watch_monitoring_configuration

Monitoring configurations for CloudWatch.

Show child fields
job_run.configuration_overrides.monitoring_configuration.cloud_watch_monitoring_configuration.log_group_name

The name of the log group for log publishing.

job_run.configuration_overrides.monitoring_configuration.cloud_watch_monitoring_configuration.log_stream_name_prefix

The specified name prefix for log streams.

job_run.configuration_overrides.monitoring_configuration.container_log_rotation_configuration

Enable or disable container log rotation.

Show child fields
job_run.configuration_overrides.monitoring_configuration.container_log_rotation_configuration.max_files_to_keep

The number of files to keep in container after rotation.

job_run.configuration_overrides.monitoring_configuration.container_log_rotation_configuration.rotation_size

The file size at which to rotate logs. Minimum of 2KB, Maximum of 2GB.

job_run.configuration_overrides.monitoring_configuration.persistent_app_ui

Monitoring configurations for the persistent application UI.

job_run.configuration_overrides.monitoring_configuration.s3_monitoring_configuration

Amazon S3 configuration for monitoring log publishing.

Show child fields
job_run.configuration_overrides.monitoring_configuration.s3_monitoring_configuration.log_uri

Amazon S3 destination URI for log publishing.

job_run.created_at

The date and time when the job run was created.

job_run.created_by

The user who created the job run.

job_run.execution_role_arn

The execution role ARN of the job run.

job_run.failure_reason

The reasons why the job run has failed.

job_run.finished_at

The date and time when the job run has finished.

job_run.id

The ID of the job run.

job_run.job_driver

Parameters of job driver for the job run.

Show child fields
job_run.job_driver.spark_sql_job_driver

The job driver for job type.

Show child fields
job_run.job_driver.spark_sql_job_driver.entry_point

The SQL file to be executed.

job_run.job_driver.spark_sql_job_driver.spark_sql_parameters

The Spark parameters to be included in the Spark SQL command.

job_run.job_driver.spark_submit_job_driver

The job driver parameters specified for spark submit.

Show child fields
job_run.job_driver.spark_submit_job_driver.entry_point

The entry point of job application.

job_run.job_driver.spark_submit_job_driver.entry_point_arguments[]
job_run.job_driver.spark_submit_job_driver.spark_submit_parameters

The Spark submit parameters that are used for job runs.

job_run.name

The name of the job run.

job_run.release_label

The release version of Amazon EMR.

job_run.retry_policy_configuration

The configuration of the retry policy that the job runs on.

Show child fields
job_run.retry_policy_configuration.max_attempts

The maximum number of attempts on the job's driver.

job_run.retry_policy_execution

The current status of the retry policy executed on the job.

Show child fields
job_run.retry_policy_execution.current_attempt_count

The current number of attempts made on the driver of the job.

job_run.state

The state of the job run.

job_run.state_details

Additional details of the job run state.

job_run.tags

The assigned tags of the job run.

job_run.virtual_cluster_id

The ID of the job run's virtual cluster.