Skip to content
AWS for Query.Farm

aws.glue.get_data_quality_rule_recommendation_run

Example SQL Queries

SELECT * FROM
aws.glue.get_data_quality_rule_recommendation_run
WHERE
"run_id" = 'VALUE';

Description

Gets the specified recommendation run that was used to generate rules.

Table Definition

Column NameColumn Data Type
run_id Required Input Column

The unique run identifier associated with this run.

VARCHAR
_aws_profile Input Column

The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role.

STRUCT(
    "type" VARCHAR,
    "name" VARCHAR,
    "account_id" VARCHAR,
    "via_profile_name" VARCHAR,
    "assumed_role_arn" VARCHAR,
    "organization" STRUCT(
        "account_name" VARCHAR,
        "id" VARCHAR,
        "tags" STRUCT(
            "key" VARCHAR,
            "value" VARCHAR
        )[],
        "master_account" STRUCT(
            "id" VARCHAR,
            "email" VARCHAR
        ),
        "parents" STRUCT(
            "type" VARCHAR,
            "id" VARCHAR,
            "name" VARCHAR,
            "tags" STRUCT(
                "key" VARCHAR,
                "value" VARCHAR
            )[]
        )[]
    )
)
Show child fields
_aws_profile.account_id

The AWS account id

_aws_profile.assumed_role_arn

The ARN of the assumed role

_aws_profile.name

The unique name of the profile.

_aws_profile.organization

Information about this profile's membership in the AWS organization.

Show child fields
_aws_profile.organization.account_name

The name of account speciifed by the organization

_aws_profile.organization.id

The organization id

_aws_profile.organization.master_account
Show child fields
_aws_profile.organization.master_account.email

The organization master account email address

_aws_profile.organization.master_account.id

The organization master account id

_aws_profile.organization.parents[]
Show child fields
_aws_profile.organization.parents[].id

The id of the parent

_aws_profile.organization.parents[].name

The name of the parent

_aws_profile.organization.parents[].tags[]
Show child fields
_aws_profile.organization.parents[].tags[].key
_aws_profile.organization.parents[].tags[].value
_aws_profile.organization.parents[].type

The type of parent can be an organization unit or a root

_aws_profile.organization.tags[]
Show child fields
_aws_profile.organization.tags[].key
_aws_profile.organization.tags[].value
_aws_profile.type

The type of profile, either 'credentials' or 'assumed_role'

_aws_profile.via_profile_name

This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.

_aws_region Input Column

The AWS region to use.

VARCHAR
completed_on

The date and time when this run was completed.

TIMESTAMP_S
created_ruleset_name

The name of the ruleset that was created by the run.

VARCHAR
data_quality_security_configuration

The name of the security configuration created with the data quality encryption option.

VARCHAR
data_source

The data source (an Glue table) associated with this run.

STRUCT(
    "glue_table" STRUCT(
        "database_name" VARCHAR,
        "table_name" VARCHAR,
        "catalog_id" VARCHAR,
        "connection_name" VARCHAR,
        "additional_options" MAP(VARCHAR, VARCHAR)
    )
)
Show child fields
data_source.glue_table

An Glue table.

Show child fields
data_source.glue_table.additional_options

Additional options for the table. Currently there are two keys supported:

  • pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset.

  • catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.

data_source.glue_table.catalog_id

A unique identifier for the Glue Data Catalog.

data_source.glue_table.connection_name

The name of the connection to the Glue Data Catalog.

data_source.glue_table.database_name

A database name in the Glue Data Catalog.

data_source.glue_table.table_name

A table name in the Glue Data Catalog.

error_string

The error strings that are associated with the run.

VARCHAR
execution_time

The amount of time (in seconds) that the run consumed resources.

BIGINT
last_modified_on

A timestamp. The last point in time when this data quality rule recommendation run was modified.

TIMESTAMP_S
number_of_workers

The number of G.1X workers to be used in the run. The default is 5.

BIGINT
recommended_ruleset

When a start rule recommendation run completes, it creates a recommended ruleset (a set of rules). This member has those rules in Data Quality Definition Language (DQDL) format.

VARCHAR
role

An IAM role supplied to encrypt the results of the run.

VARCHAR
started_on

The date and time when this run started.

TIMESTAMP_S
status

The status for this run.

VARCHAR
timeout

The timeout for a run in minutes. This is the maximum time that a run can consume resources before it is terminated and enters TIMEOUT status. The default is 2,880 minutes (48 hours).

BIGINT