Skip to content
AWS for Query.Farm

aws.glue.list_data_quality_statistics

Example SQL Queries

SELECT * FROM
aws.glue.list_data_quality_statistics;

Description

Retrieves a list of data quality statistics.

Table Definition

Column NameColumn Data Type
max_results Input Column

The maximum number of results to return in this request.

BIGINT
next_token Input Column

A pagination token to request the next page of results.

VARCHAR
profile_id Input Column

The Profile ID.

VARCHAR
statistic_id Input Column

The Statistic ID.

VARCHAR
timestamp_filter Input Column

A timestamp filter.

STRUCT(
    "recorded_before" TIMESTAMP_S,
    "recorded_after" TIMESTAMP_S
)
Show child fields
timestamp_filter.recorded_after

The timestamp after which statistics should be included in the results.

timestamp_filter.recorded_before

The timestamp before which statistics should be included in the results.

_aws_profile Input Column

The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role.

STRUCT(
    "type" VARCHAR,
    "name" VARCHAR,
    "account_id" VARCHAR,
    "via_profile_name" VARCHAR,
    "assumed_role_arn" VARCHAR,
    "organization" STRUCT(
        "account_name" VARCHAR,
        "id" VARCHAR,
        "tags" STRUCT(
            "key" VARCHAR,
            "value" VARCHAR
        )[],
        "master_account" STRUCT(
            "id" VARCHAR,
            "email" VARCHAR
        ),
        "parents" STRUCT(
            "type" VARCHAR,
            "id" VARCHAR,
            "name" VARCHAR,
            "tags" STRUCT(
                "key" VARCHAR,
                "value" VARCHAR
            )[]
        )[]
    )
)
Show child fields
_aws_profile.account_id

The AWS account id

_aws_profile.assumed_role_arn

The ARN of the assumed role

_aws_profile.name

The unique name of the profile.

_aws_profile.organization

Information about this profile's membership in the AWS organization.

Show child fields
_aws_profile.organization.account_name

The name of account speciifed by the organization

_aws_profile.organization.id

The organization id

_aws_profile.organization.master_account
Show child fields
_aws_profile.organization.master_account.email

The organization master account email address

_aws_profile.organization.master_account.id

The organization master account id

_aws_profile.organization.parents[]
Show child fields
_aws_profile.organization.parents[].id

The id of the parent

_aws_profile.organization.parents[].name

The name of the parent

_aws_profile.organization.parents[].tags[]
Show child fields
_aws_profile.organization.parents[].tags[].key
_aws_profile.organization.parents[].tags[].value
_aws_profile.organization.parents[].type

The type of parent can be an organization unit or a root

_aws_profile.organization.tags[]
Show child fields
_aws_profile.organization.tags[].key
_aws_profile.organization.tags[].value
_aws_profile.type

The type of profile, either 'credentials' or 'assumed_role'

_aws_profile.via_profile_name

This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.

_aws_region Input Column

The AWS region to use.

VARCHAR
statistics

A StatisticSummaryList.

STRUCT(
    "statistic_id" VARCHAR,
    "profile_id" VARCHAR,
    "run_identifier" STRUCT(
        "run_id" VARCHAR,
        "job_run_id" VARCHAR
    ),
    "statistic_name" VARCHAR,
    "double_value" DOUBLE,
    "evaluation_level" VARCHAR,
    "columns_referenced" VARCHAR[],
    "referenced_datasets" VARCHAR[],
    "statistic_properties" MAP(VARCHAR, VARCHAR),
    "recorded_on" TIMESTAMP_S,
    "inclusion_annotation" STRUCT(
        "value" VARCHAR,
        "last_modified_on" TIMESTAMP_S
    )
)[]
Show child fields
statistics[]
Show child fields
statistics[].columns_referenced[]
statistics[].double_value

The value of the statistic.

statistics[].evaluation_level

The evaluation level of the statistic. Possible values: Dataset, Column, Multicolumn.

statistics[].inclusion_annotation

The inclusion annotation for the statistic.

Show child fields
statistics[].inclusion_annotation.last_modified_on

The timestamp when the inclusion annotation was last modified.

statistics[].inclusion_annotation.value

The inclusion annotation value.

statistics[].profile_id

The Profile ID.

statistics[].recorded_on

The timestamp when the statistic was recorded.

statistics[].referenced_datasets[]
statistics[].run_identifier

The Run Identifier

Show child fields
statistics[].run_identifier.job_run_id

The Job Run ID.

statistics[].run_identifier.run_id

The Run ID.

statistics[].statistic_id

The Statistic ID.

statistics[].statistic_name

The name of the statistic.

statistics[].statistic_properties

A StatisticPropertiesMap, which contains a NameString and DescriptionString