Skip to content
AWS for Query.Farm

aws.glue.list_table_optimizer_runs

Example SQL Queries

SELECT * FROM
aws.glue.list_table_optimizer_runs
WHERE
"catalog_id" = 'VALUE'
AND "database_name" = 'VALUE'
AND "table_name" = 'VALUE'
AND "type" = 'VALUE';

Description

Lists the history of previous optimizer runs for a specific table.

Table Definition

Column NameColumn Data Type
catalog_id Required Input Column

The Catalog ID of the table.

VARCHAR
database_name Required Input Column

The name of the database in the catalog in which the table resides.

VARCHAR
table_name Required Input Column

The name of the table.

VARCHAR
type Required Input Column

The type of table optimizer. Currently, the only valid value is compaction.

VARCHAR
max_results Input Column

The maximum number of optimizer runs to return on each call.

BIGINT
next_token Input Column

A continuation token for paginating the returned list of optimizer runs, returned if the current segment of the list is not the last.

VARCHAR
_aws_profile Input Column

The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role.

STRUCT(
    "type" VARCHAR,
    "name" VARCHAR,
    "account_id" VARCHAR,
    "via_profile_name" VARCHAR,
    "assumed_role_arn" VARCHAR,
    "organization" STRUCT(
        "account_name" VARCHAR,
        "id" VARCHAR,
        "tags" STRUCT(
            "key" VARCHAR,
            "value" VARCHAR
        )[],
        "master_account" STRUCT(
            "id" VARCHAR,
            "email" VARCHAR
        ),
        "parents" STRUCT(
            "type" VARCHAR,
            "id" VARCHAR,
            "name" VARCHAR,
            "tags" STRUCT(
                "key" VARCHAR,
                "value" VARCHAR
            )[]
        )[]
    )
)
Show child fields
_aws_profile.account_id

The AWS account id

_aws_profile.assumed_role_arn

The ARN of the assumed role

_aws_profile.name

The unique name of the profile.

_aws_profile.organization

Information about this profile's membership in the AWS organization.

Show child fields
_aws_profile.organization.account_name

The name of account speciifed by the organization

_aws_profile.organization.id

The organization id

_aws_profile.organization.master_account
Show child fields
_aws_profile.organization.master_account.email

The organization master account email address

_aws_profile.organization.master_account.id

The organization master account id

_aws_profile.organization.parents[]
Show child fields
_aws_profile.organization.parents[].id

The id of the parent

_aws_profile.organization.parents[].name

The name of the parent

_aws_profile.organization.parents[].tags[]
Show child fields
_aws_profile.organization.parents[].tags[].key
_aws_profile.organization.parents[].tags[].value
_aws_profile.organization.parents[].type

The type of parent can be an organization unit or a root

_aws_profile.organization.tags[]
Show child fields
_aws_profile.organization.tags[].key
_aws_profile.organization.tags[].value
_aws_profile.type

The type of profile, either 'credentials' or 'assumed_role'

_aws_profile.via_profile_name

This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.

_aws_region Input Column

The AWS region to use.

VARCHAR
table_optimizer_runs

A list of the optimizer runs associated with a table.

STRUCT(
    "event_type" VARCHAR,
    "start_timestamp" TIMESTAMP_S,
    "end_timestamp" TIMESTAMP_S,
    "metrics" STRUCT(
        "number_of_bytes_compacted" VARCHAR,
        "number_of_files_compacted" VARCHAR,
        "number_of_dpus" VARCHAR,
        "job_duration_in_hour" VARCHAR
    ),
    "error" VARCHAR
)[]
Show child fields
table_optimizer_runs[]
Show child fields
table_optimizer_runs[].end_timestamp

Represents the epoch timestamp at which the compaction job ended.

table_optimizer_runs[].error

An error that occured during the optimizer run.

table_optimizer_runs[].event_type

An event type representing the status of the table optimizer run.

table_optimizer_runs[].metrics

A RunMetrics object containing metrics for the optimizer run.

Show child fields
table_optimizer_runs[].metrics.job_duration_in_hour

The duration of the job in hours.

table_optimizer_runs[].metrics.number_of_bytes_compacted

The number of bytes removed by the compaction job run.

table_optimizer_runs[].metrics.number_of_dpus

The number of DPU hours consumed by the job.

table_optimizer_runs[].metrics.number_of_files_compacted

The number of files removed by the compaction job run.

table_optimizer_runs[].start_timestamp

Represents the epoch timestamp at which the compaction job was started within Lake Formation.