| Column Name | Column Data Type |
identifier Required Input Column
A unique identifier. | VARCHAR |
_aws_profile Input Column
The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role. | STRUCT( "type" VARCHAR, "name" VARCHAR, "account_id" VARCHAR, "via_profile_name" VARCHAR, "assumed_role_arn" VARCHAR, "organization" STRUCT( "account_name" VARCHAR, "id" VARCHAR, "tags" STRUCT( "key" VARCHAR, "value" VARCHAR )[], "master_account" STRUCT( "id" VARCHAR, "email" VARCHAR ), "parents" STRUCT( "type" VARCHAR, "id" VARCHAR, "name" VARCHAR, "tags" STRUCT( "key" VARCHAR, "value" VARCHAR )[] )[] ) ) |
Show child fields- _aws_profile.account_id
The AWS account id
- _aws_profile.assumed_role_arn
The ARN of the assumed role
- _aws_profile.name
The unique name of the profile.
- _aws_profile.organization
Information about this profile's membership in the AWS organization. Show child fields- _aws_profile.organization.account_name
The name of account speciifed by the organization
- _aws_profile.organization.id
The organization id
- _aws_profile.organization.master_account
Show child fields- _aws_profile.organization.master_account.email
The organization master account email address
- _aws_profile.organization.master_account.id
The organization master account id
- _aws_profile.organization.parents[]
Show child fields- _aws_profile.organization.parents[].id
The id of the parent
- _aws_profile.organization.parents[].name
The name of the parent
- _aws_profile.organization.parents[].tags[]
Show child fields- _aws_profile.organization.parents[].tags[].key
- _aws_profile.organization.parents[].tags[].value
- _aws_profile.organization.parents[].type
The type of parent can be an organization unit or a root
- _aws_profile.organization.tags[]
Show child fields- _aws_profile.organization.tags[].key
- _aws_profile.organization.tags[].value
- _aws_profile.type
The type of profile, either 'credentials' or 'assumed_role'
- _aws_profile.via_profile_name
This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.
|
arn
The Amazon Resource Name (ARN) for the DataIntegration. | VARCHAR |
description
The KMS key ARN for the DataIntegration. | VARCHAR |
file_configuration
The configuration for what files should be pulled from the source. | STRUCT( "folders" VARCHAR[], "filters" MAP(VARCHAR, VARCHAR[]) ) |
Show child fields- file_configuration.filters
Restrictions for what files should be pulled from the source.
- file_configuration.folders[]
|
id
A unique identifier. | VARCHAR |
kms_key
The KMS key ARN for the DataIntegration. | VARCHAR |
name
The name of the DataIntegration. | VARCHAR |
object_configuration
The configuration for what data should be pulled from the source. | MAP(VARCHAR, MAP(VARCHAR, VARCHAR[])) |
schedule_configuration
The name of the data and how often it should be pulled from the source. | STRUCT( "first_execution_from" VARCHAR, "object" VARCHAR, "schedule_expression" VARCHAR ) |
Show child fields- schedule_configuration.first_execution_from
The start date for objects to import in the first flow run as an Unix/epoch timestamp in milliseconds or in ISO-8601 format.
- schedule_configuration.object
The name of the object to pull from the data source.
- schedule_configuration.schedule_expression
How often the data should be pulled from data source.
|
source_uri
The URI of the data source. | VARCHAR |
tags
The tags used to organize, track, or control access for this resource. For example, { "tags": {"key1":"value1", "key2":"value2"} }. | MAP(VARCHAR, VARCHAR) |