| Column Name | Column Data Type |
|---|
created_after Input Column
The date and time after which the job templates were created. | TIMESTAMP_S |
created_before Input Column
The date and time before which the job templates were created. | TIMESTAMP_S |
_aws_profile Input Column
The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role. | STRUCT(
"type" VARCHAR,
"name" VARCHAR,
"account_id" VARCHAR,
"via_profile_name" VARCHAR,
"assumed_role_arn" VARCHAR,
"organization" STRUCT(
"account_name" VARCHAR,
"id" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[],
"master_account" STRUCT(
"id" VARCHAR,
"email" VARCHAR
),
"parents" STRUCT(
"type" VARCHAR,
"id" VARCHAR,
"name" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[]
)[]
)
) |
Show child fields- _aws_profile.account_id
The AWS account id - _aws_profile.assumed_role_arn
The ARN of the assumed role - _aws_profile.name
The unique name of the profile. - _aws_profile.organization
Information about this profile's membership in the AWS organization. Show child fields- _aws_profile.organization.account_name
The name of account speciifed by the organization - _aws_profile.organization.id
The organization id - _aws_profile.organization.master_account
Show child fields- _aws_profile.organization.master_account.email
The organization master account email address - _aws_profile.organization.master_account.id
The organization master account id
- _aws_profile.organization.parents[]
Show child fields- _aws_profile.organization.parents[].id
The id of the parent - _aws_profile.organization.parents[].name
The name of the parent - _aws_profile.organization.parents[].tags[]
Show child fields- _aws_profile.organization.parents[].tags[].key
- _aws_profile.organization.parents[].tags[].value
- _aws_profile.organization.parents[].type
The type of parent can be an organization unit or a root
- _aws_profile.organization.tags[]
Show child fields- _aws_profile.organization.tags[].key
- _aws_profile.organization.tags[].value
- _aws_profile.type
The type of profile, either 'credentials' or 'assumed_role' - _aws_profile.via_profile_name
This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.
|
_aws_region Input Column
The AWS region to use. | VARCHAR |
arn
The ARN of the job template. | VARCHAR |
created_at
The date and time when the job template was created. | TIMESTAMP_S |
created_by
The user who created the job template. | VARCHAR |
decryption_error
The error message in case the decryption of job template fails. | VARCHAR |
id
The ID of the job template. | VARCHAR |
job_template_data
The job template data which holds values of StartJobRun API request. | STRUCT(
"execution_role_arn" VARCHAR,
"release_label" VARCHAR,
"configuration_overrides" STRUCT(
"application_configuration" STRUCT(
"classification" VARCHAR,
"properties" MAP(VARCHAR, VARCHAR)
)[],
"monitoring_configuration" STRUCT(
"persistent_app_ui" VARCHAR,
"cloud_watch_monitoring_configuration" STRUCT(
"log_group_name" VARCHAR,
"log_stream_name_prefix" VARCHAR
),
"s3_monitoring_configuration" STRUCT(
"log_uri" VARCHAR
)
)
),
"job_driver" STRUCT(
"spark_submit_job_driver" STRUCT(
"entry_point" VARCHAR,
"entry_point_arguments" VARCHAR[],
"spark_submit_parameters" VARCHAR
),
"spark_sql_job_driver" STRUCT(
"entry_point" VARCHAR,
"spark_sql_parameters" VARCHAR
)
),
"parameter_configuration" MAP(VARCHAR, STRUCT(
"type" VARCHAR,
"default_value" VARCHAR
)),
"job_tags" MAP(VARCHAR, VARCHAR)
) |
Show child fields- job_template_data.configuration_overrides
The configuration settings that are used to override defaults configuration. Show child fields- job_template_data.configuration_overrides.application_configuration[]
Show child fields- job_template_data.configuration_overrides.application_configuration[].classification
The classification within a configuration. - job_template_data.configuration_overrides.application_configuration[].properties
A set of properties specified within a configuration classification.
- job_template_data.configuration_overrides.monitoring_configuration
The configurations for monitoring. Show child fields- job_template_data.configuration_overrides.monitoring_configuration.cloud_watch_monitoring_configuration
Monitoring configurations for CloudWatch. Show child fields- job_template_data.configuration_overrides.monitoring_configuration.cloud_watch_monitoring_configuration.log_group_name
The name of the log group for log publishing. - job_template_data.configuration_overrides.monitoring_configuration.cloud_watch_monitoring_configuration.log_stream_name_prefix
The specified name prefix for log streams.
- job_template_data.configuration_overrides.monitoring_configuration.persistent_app_ui
Monitoring configurations for the persistent application UI. - job_template_data.configuration_overrides.monitoring_configuration.s3_monitoring_configuration
Amazon S3 configuration for monitoring log publishing. Show child fields- job_template_data.configuration_overrides.monitoring_configuration.s3_monitoring_configuration.log_uri
Amazon S3 destination URI for log publishing.
- job_template_data.execution_role_arn
The execution role ARN of the job run. - job_template_data.job_driver
Specify the driver that the job runs on. Exactly one of the two available job drivers is required, either sparkSqlJobDriver or sparkSubmitJobDriver. Show child fields- job_template_data.job_driver.spark_sql_job_driver
The job driver for job type. Show child fields- job_template_data.job_driver.spark_sql_job_driver.entry_point
The SQL file to be executed. - job_template_data.job_driver.spark_sql_job_driver.spark_sql_parameters
The Spark parameters to be included in the Spark SQL command.
- job_template_data.job_driver.spark_submit_job_driver
The job driver parameters specified for spark submit. Show child fields- job_template_data.job_driver.spark_submit_job_driver.entry_point
The entry point of job application. - job_template_data.job_driver.spark_submit_job_driver.entry_point_arguments[]
- job_template_data.job_driver.spark_submit_job_driver.spark_submit_parameters
The Spark submit parameters that are used for job runs.
- job_template_data.job_tags
The tags assigned to jobs started using the job template. - job_template_data.parameter_configuration
The configuration of parameters existing in the job template. - job_template_data.release_label
The release version of Amazon EMR.
|
kms_key_arn
The KMS key ARN used to encrypt the job template. | VARCHAR |
name
The name of the job template. | VARCHAR |
tags
The tags assigned to the job template. | MAP(VARCHAR, VARCHAR) |