Skip to content
AWS for Query.Farm

aws.datazone.get_data_source

Example SQL Queries

SELECT * FROM
aws.datazone.get_data_source
WHERE
"domain_identifier" = 'VALUE'
AND "identifier" = 'VALUE';

Description

Gets an Amazon DataZone data source.

Table Definition

Column NameColumn Data Type
domain_identifier Required Input Column

The ID of the Amazon DataZone domain in which the data source exists.

VARCHAR
identifier Required Input Column

The ID of the Amazon DataZone data source.

VARCHAR
_aws_profile Input Column

The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role.

STRUCT(
    "type" VARCHAR,
    "name" VARCHAR,
    "account_id" VARCHAR,
    "via_profile_name" VARCHAR,
    "assumed_role_arn" VARCHAR,
    "organization" STRUCT(
        "account_name" VARCHAR,
        "id" VARCHAR,
        "tags" STRUCT(
            "key" VARCHAR,
            "value" VARCHAR
        )[],
        "master_account" STRUCT(
            "id" VARCHAR,
            "email" VARCHAR
        ),
        "parents" STRUCT(
            "type" VARCHAR,
            "id" VARCHAR,
            "name" VARCHAR,
            "tags" STRUCT(
                "key" VARCHAR,
                "value" VARCHAR
            )[]
        )[]
    )
)
Show child fields
_aws_profile.account_id

The AWS account id

_aws_profile.assumed_role_arn

The ARN of the assumed role

_aws_profile.name

The unique name of the profile.

_aws_profile.organization

Information about this profile's membership in the AWS organization.

Show child fields
_aws_profile.organization.account_name

The name of account speciifed by the organization

_aws_profile.organization.id

The organization id

_aws_profile.organization.master_account
Show child fields
_aws_profile.organization.master_account.email

The organization master account email address

_aws_profile.organization.master_account.id

The organization master account id

_aws_profile.organization.parents[]
Show child fields
_aws_profile.organization.parents[].id

The id of the parent

_aws_profile.organization.parents[].name

The name of the parent

_aws_profile.organization.parents[].tags[]
Show child fields
_aws_profile.organization.parents[].tags[].key
_aws_profile.organization.parents[].tags[].value
_aws_profile.organization.parents[].type

The type of parent can be an organization unit or a root

_aws_profile.organization.tags[]
Show child fields
_aws_profile.organization.tags[].key
_aws_profile.organization.tags[].value
_aws_profile.type

The type of profile, either 'credentials' or 'assumed_role'

_aws_profile.via_profile_name

This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.

_aws_region Input Column

The AWS region to use.

VARCHAR
asset_forms_output

The metadata forms attached to the assets created by this data source.

STRUCT(
    "content" VARCHAR,
    "form_name" VARCHAR,
    "type_name" VARCHAR,
    "type_revision" VARCHAR
)[]
Show child fields
asset_forms_output[]
Show child fields
asset_forms_output[].content

The content of the metadata form.

asset_forms_output[].form_name

The name of the metadata form.

asset_forms_output[].type_name

The name of the metadata form type.

asset_forms_output[].type_revision

The revision of the metadata form type.

configuration

The configuration of the data source.

STRUCT(
    "glue_run_configuration" STRUCT(
        "account_id" VARCHAR,
        "auto_import_data_quality_result" BOOLEAN,
        "data_access_role" VARCHAR,
        "region" VARCHAR,
        "relational_filter_configurations" STRUCT(
            "database_name" VARCHAR,
            "filter_expressions" STRUCT(
                "expression" VARCHAR,
                "type" VARCHAR
            )[],
            "schema_name" VARCHAR
        )[]
    ),
    "redshift_run_configuration" STRUCT(
        "account_id" VARCHAR,
        "data_access_role" VARCHAR,
        "redshift_credential_configuration" STRUCT(
            "secret_manager_arn" VARCHAR
        ),
        "redshift_storage" STRUCT(
            "redshift_cluster_source" STRUCT(
                "cluster_name" VARCHAR
            ),
            "redshift_serverless_source" STRUCT(
                "workgroup_name" VARCHAR
            )
        ),
        "region" VARCHAR,
        "relational_filter_configurations" STRUCT(
            "database_name" VARCHAR,
            "filter_expressions" STRUCT(
                "expression" VARCHAR,
                "type" VARCHAR
            )[],
            "schema_name" VARCHAR
        )[]
    )
)
Show child fields
configuration.glue_run_configuration

The configuration of the Amazon Web Services Glue data source.

Show child fields
configuration.glue_run_configuration.account_id

The Amazon Web Services account ID included in the configuration details of the Amazon Web Services Glue data source.

configuration.glue_run_configuration.auto_import_data_quality_result

Specifies whether to automatically import data quality metrics as part of the data source run.

configuration.glue_run_configuration.data_access_role

The data access role included in the configuration details of the Amazon Web Services Glue data source.

configuration.glue_run_configuration.region

The Amazon Web Services region included in the configuration details of the Amazon Web Services Glue data source.

configuration.glue_run_configuration.relational_filter_configurations[]
Show child fields
configuration.glue_run_configuration.relational_filter_configurations[].database_name

The database name specified in the relational filter configuration for the data source.

configuration.glue_run_configuration.relational_filter_configurations[].filter_expressions[]
Show child fields
configuration.glue_run_configuration.relational_filter_configurations[].filter_expressions[].expression

The search filter expression.

configuration.glue_run_configuration.relational_filter_configurations[].filter_expressions[].type

The search filter explresison type.

configuration.glue_run_configuration.relational_filter_configurations[].schema_name

The schema name specified in the relational filter configuration for the data source.

configuration.redshift_run_configuration

The configuration of the Amazon Redshift data source.

Show child fields
configuration.redshift_run_configuration.account_id

The ID of the Amazon Web Services account included in the configuration details of the Amazon Redshift data source.

configuration.redshift_run_configuration.data_access_role

The data access role included in the configuration details of the Amazon Redshift data source.

configuration.redshift_run_configuration.redshift_credential_configuration

The details of the credentials required to access an Amazon Redshift cluster.

Show child fields
configuration.redshift_run_configuration.redshift_credential_configuration.secret_manager_arn

The ARN of a secret manager for an Amazon Redshift cluster.

configuration.redshift_run_configuration.redshift_storage

The details of the Amazon Redshift storage as part of the configuration of an Amazon Redshift data source run.

Show child fields
configuration.redshift_run_configuration.redshift_storage.redshift_cluster_source

The details of the Amazon Redshift cluster source.

Show child fields
configuration.redshift_run_configuration.redshift_storage.redshift_cluster_source.cluster_name

The name of an Amazon Redshift cluster.

configuration.redshift_run_configuration.redshift_storage.redshift_serverless_source

The details of the Amazon Redshift Serverless workgroup source.

Show child fields
configuration.redshift_run_configuration.redshift_storage.redshift_serverless_source.workgroup_name

The name of the Amazon Redshift Serverless workgroup.

configuration.redshift_run_configuration.region

The Amazon Web Services region included in the configuration details of the Amazon Redshift data source.

configuration.redshift_run_configuration.relational_filter_configurations[]
Show child fields
configuration.redshift_run_configuration.relational_filter_configurations[].database_name

The database name specified in the relational filter configuration for the data source.

configuration.redshift_run_configuration.relational_filter_configurations[].filter_expressions[]
Show child fields
configuration.redshift_run_configuration.relational_filter_configurations[].filter_expressions[].expression

The search filter expression.

configuration.redshift_run_configuration.relational_filter_configurations[].filter_expressions[].type

The search filter explresison type.

configuration.redshift_run_configuration.relational_filter_configurations[].schema_name

The schema name specified in the relational filter configuration for the data source.

created_at

The timestamp of when the data source was created.

TIMESTAMP_S
description

The description of the data source.

VARCHAR
domain_id

The ID of the Amazon DataZone domain in which the data source exists.

VARCHAR
enable_setting

Specifies whether this data source is enabled or not.

VARCHAR
environment_id

The ID of the environment where this data source creates and publishes assets,

VARCHAR
error_message

Specifies the error message that is returned if the operation cannot be successfully completed.

STRUCT(
    "error_detail" VARCHAR,
    "error_type" VARCHAR
)
Show child fields
error_message.error_detail

The details of the error message that is returned if the operation cannot be successfully completed.

error_message.error_type

The type of the error message that is returned if the operation cannot be successfully completed.

id

The ID of the data source.

VARCHAR
last_run_asset_count

The number of assets created by the data source during its last run.

BIGINT
last_run_at

The timestamp of the last run of the data source.

TIMESTAMP_S
last_run_error_message

Specifies the error message that is returned if the operation cannot be successfully completed.

STRUCT(
    "error_detail" VARCHAR,
    "error_type" VARCHAR
)
Show child fields
last_run_error_message.error_detail

The details of the error message that is returned if the operation cannot be successfully completed.

last_run_error_message.error_type

The type of the error message that is returned if the operation cannot be successfully completed.

last_run_status

The status of the last run of the data source.

VARCHAR
name

The name of the data source.

VARCHAR
project_id

The ID of the project where the data source creates and publishes assets.

VARCHAR
publish_on_import

Specifies whether the assets that this data source creates in the inventory are to be also automatically published to the catalog.

BOOLEAN
recommendation

The recommendation configuration of the data source.

STRUCT(
    "enable_business_name_generation" BOOLEAN
)
Show child fields
recommendation.enable_business_name_generation

Specifies whether automatic business name generation is to be enabled or not as part of the recommendation configuration.

schedule

The schedule of the data source runs.

STRUCT(
    "schedule" VARCHAR,
    "timezone" VARCHAR
)
Show child fields
schedule.schedule

The schedule of the data source runs.

schedule.timezone

The timezone of the data source run.

self_grant_status

Specifies the status of the self-granting functionality.

STRUCT(
    "glue_self_grant_status" STRUCT(
        "self_grant_status_details" STRUCT(
            "database_name" VARCHAR,
            "failure_cause" VARCHAR,
            "schema_name" VARCHAR,
            "status" VARCHAR
        )[]
    ),
    "redshift_self_grant_status" STRUCT(
        "self_grant_status_details" STRUCT(
            "database_name" VARCHAR,
            "failure_cause" VARCHAR,
            "schema_name" VARCHAR,
            "status" VARCHAR
        )[]
    )
)
Show child fields
self_grant_status.glue_self_grant_status

The details for the self granting status for a Glue data source.

Show child fields
self_grant_status.glue_self_grant_status.self_grant_status_details[]
Show child fields
self_grant_status.glue_self_grant_status.self_grant_status_details[].database_name

The name of the database used for the data source.

self_grant_status.glue_self_grant_status.self_grant_status_details[].failure_cause

The reason for why the operation failed.

self_grant_status.glue_self_grant_status.self_grant_status_details[].schema_name

The name of the schema used in the data source.

self_grant_status.glue_self_grant_status.self_grant_status_details[].status

The self granting status of the data source.

self_grant_status.redshift_self_grant_status

The details for the self granting status for an Amazon Redshift data source.

Show child fields
self_grant_status.redshift_self_grant_status.self_grant_status_details[]
Show child fields
self_grant_status.redshift_self_grant_status.self_grant_status_details[].database_name

The name of the database used for the data source.

self_grant_status.redshift_self_grant_status.self_grant_status_details[].failure_cause

The reason for why the operation failed.

self_grant_status.redshift_self_grant_status.self_grant_status_details[].schema_name

The name of the schema used in the data source.

self_grant_status.redshift_self_grant_status.self_grant_status_details[].status

The self granting status of the data source.

status

The status of the data source.

VARCHAR
type

The type of the data source.

VARCHAR
updated_at

The timestamp of when the data source was updated.

TIMESTAMP_S