| Column Name | Column Data Type |
|---|
source Required Input Column
Specifies the source table. | STRUCT(
"database_name" VARCHAR,
"table_name" VARCHAR
) |
Show child fields- source.database_name
The database in which the table metadata resides. - source.table_name
The name of the table in question.
|
location Input Column
Parameters for the mapping. | STRUCT(
"jdbc" STRUCT(
"name" VARCHAR,
"value" VARCHAR,
"param" BOOLEAN
)[],
"s3" STRUCT(
"name" VARCHAR,
"value" VARCHAR,
"param" BOOLEAN
)[],
"dynamo_db" STRUCT(
"name" VARCHAR,
"value" VARCHAR,
"param" BOOLEAN
)[]
) |
Show child fields- location.dynamo_db[]
Show child fields- location.dynamo_db[].name
The name of the argument or property. - location.dynamo_db[].param
True if the value is used as a parameter. - location.dynamo_db[].value
The value of the argument or property.
- location.jdbc[]
Show child fields- location.jdbc[].name
The name of the argument or property. - location.jdbc[].param
True if the value is used as a parameter. - location.jdbc[].value
The value of the argument or property.
- location.s3[]
Show child fields- location.s3[].name
The name of the argument or property. - location.s3[].param
True if the value is used as a parameter. - location.s3[].value
The value of the argument or property.
|
sinks Input Column
A list of target tables. | STRUCT(
"database_name" VARCHAR,
"table_name" VARCHAR
)[] |
Show child fields- sinks[]
Show child fields- sinks[].database_name
The database in which the table metadata resides. - sinks[].table_name
The name of the table in question.
|
_aws_profile Input Column
The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role. | STRUCT(
"type" VARCHAR,
"name" VARCHAR,
"account_id" VARCHAR,
"via_profile_name" VARCHAR,
"assumed_role_arn" VARCHAR,
"organization" STRUCT(
"account_name" VARCHAR,
"id" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[],
"master_account" STRUCT(
"id" VARCHAR,
"email" VARCHAR
),
"parents" STRUCT(
"type" VARCHAR,
"id" VARCHAR,
"name" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[]
)[]
)
) |
Show child fields- _aws_profile.account_id
The AWS account id - _aws_profile.assumed_role_arn
The ARN of the assumed role - _aws_profile.name
The unique name of the profile. - _aws_profile.organization
Information about this profile's membership in the AWS organization. Show child fields- _aws_profile.organization.account_name
The name of account speciifed by the organization - _aws_profile.organization.id
The organization id - _aws_profile.organization.master_account
Show child fields- _aws_profile.organization.master_account.email
The organization master account email address - _aws_profile.organization.master_account.id
The organization master account id
- _aws_profile.organization.parents[]
Show child fields- _aws_profile.organization.parents[].id
The id of the parent - _aws_profile.organization.parents[].name
The name of the parent - _aws_profile.organization.parents[].tags[]
Show child fields- _aws_profile.organization.parents[].tags[].key
- _aws_profile.organization.parents[].tags[].value
- _aws_profile.organization.parents[].type
The type of parent can be an organization unit or a root
- _aws_profile.organization.tags[]
Show child fields- _aws_profile.organization.tags[].key
- _aws_profile.organization.tags[].value
- _aws_profile.type
The type of profile, either 'credentials' or 'assumed_role' - _aws_profile.via_profile_name
This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.
|
_aws_region Input Column
The AWS region to use. | VARCHAR |
mapping
A list of mappings to the specified targets. | STRUCT(
"source_table" VARCHAR,
"source_path" VARCHAR,
"source_type" VARCHAR,
"target_table" VARCHAR,
"target_path" VARCHAR,
"target_type" VARCHAR
)[] |
Show child fields- mapping[]
Show child fields- mapping[].source_path
The source path. - mapping[].source_table
The name of the source table. - mapping[].source_type
The source type. - mapping[].target_path
The target path. - mapping[].target_table
The target table. - mapping[].target_type
The target type.
|