Skip to content

aws.glue.get_column_statistics_task_runs

Example SQL Queries

SELECT * FROM
aws.glue.get_column_statistics_task_runs
WHERE
"database_name" = 'VALUE'
AND "table_name" = 'VALUE';

Description

Retrieves information about all runs associated with the specified table.

Table Definition

Column NameColumn Data Type
database_name Required Input Column

The name of the database where the table resides.

VARCHAR
table_name Required Input Column

The name of the table.

VARCHAR
max_results Input Column

The maximum size of the response.

BIGINT
next_token Input Column

A continuation token, if not all task runs have yet been returned.

VARCHAR
_aws_profile Input Column

The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role.

STRUCT(
"type" VARCHAR,
"name" VARCHAR,
"account_id" VARCHAR,
"via_profile_name" VARCHAR,
"assumed_role_arn" VARCHAR,
"organization" STRUCT(
"account_name" VARCHAR,
"id" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[],
"master_account" STRUCT(
"id" VARCHAR,
"email" VARCHAR
),
"parents" STRUCT(
"type" VARCHAR,
"id" VARCHAR,
"name" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[]
)[]
)
)
Show child fields
_aws_profile.account_id

The AWS account id

_aws_profile.assumed_role_arn

The ARN of the assumed role

_aws_profile.name

The unique name of the profile.

_aws_profile.organization

Information about this profile's membership in the AWS organization.

Show child fields
_aws_profile.organization.account_name

The name of account speciifed by the organization

_aws_profile.organization.id

The organization id

_aws_profile.organization.master_account
Show child fields
_aws_profile.organization.master_account.email

The organization master account email address

_aws_profile.organization.master_account.id

The organization master account id

_aws_profile.organization.parents[]
Show child fields
_aws_profile.organization.parents[].id

The id of the parent

_aws_profile.organization.parents[].name

The name of the parent

_aws_profile.organization.parents[].tags[]
Show child fields
_aws_profile.organization.parents[].tags[].key
_aws_profile.organization.parents[].tags[].value
_aws_profile.organization.parents[].type

The type of parent can be an organization unit or a root

_aws_profile.organization.tags[]
Show child fields
_aws_profile.organization.tags[].key
_aws_profile.organization.tags[].value
_aws_profile.type

The type of profile, either 'credentials' or 'assumed_role'

_aws_profile.via_profile_name

This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.

_aws_region Input Column

The AWS region to use.

VARCHAR
column_statistics_task_runs

A list of column statistics task runs.

STRUCT(
"customer_id" VARCHAR,
"column_statistics_task_run_id" VARCHAR,
"database_name" VARCHAR,
"table_name" VARCHAR,
"column_name_list" VARCHAR[],
"catalog_id" VARCHAR,
"role" VARCHAR,
"sample_size" DOUBLE,
"security_configuration" VARCHAR,
"number_of_workers" BIGINT,
"worker_type" VARCHAR,
"status" VARCHAR,
"creation_time" TIMESTAMP_S,
"last_updated" TIMESTAMP_S,
"start_time" TIMESTAMP_S,
"end_time" TIMESTAMP_S,
"error_message" VARCHAR,
"dpu_seconds" DOUBLE
)[]
Show child fields
column_statistics_task_runs[]
Show child fields
column_statistics_task_runs[].catalog_id

The ID of the Data Catalog where the table resides. If none is supplied, the Amazon Web Services account ID is used by default.

column_statistics_task_runs[].column_name_list[]
column_statistics_task_runs[].column_statistics_task_run_id

The identifier for the particular column statistics task run.

column_statistics_task_runs[].creation_time

The time that this task was created.

column_statistics_task_runs[].customer_id

The Amazon Web Services account ID.

column_statistics_task_runs[].database_name

The database where the table resides.

column_statistics_task_runs[].dpu_seconds

The calculated DPU usage in seconds for all autoscaled workers.

column_statistics_task_runs[].end_time

The end time of the task.

column_statistics_task_runs[].error_message

The error message for the job.

column_statistics_task_runs[].last_updated

The last point in time when this task was modified.

column_statistics_task_runs[].number_of_workers

The number of workers used to generate column statistics. The job is preconfigured to autoscale up to 25 instances.

column_statistics_task_runs[].role

The IAM role that the service assumes to generate statistics.

column_statistics_task_runs[].sample_size

The percentage of rows used to generate statistics. If none is supplied, the entire table will be used to generate stats.

column_statistics_task_runs[].security_configuration

Name of the security configuration that is used to encrypt CloudWatch logs for the column stats task run.

column_statistics_task_runs[].start_time

The start time of the task.

column_statistics_task_runs[].status

The status of the task run.

column_statistics_task_runs[].table_name

The name of the table for which column statistics is generated.

column_statistics_task_runs[].worker_type

The type of workers being used for generating stats. The default is g.1x.