| Column Name | Column Data Type |
|---|
mapping Required Input Column
The list of mappings from a source table to target tables. | STRUCT(
"source_table" VARCHAR,
"source_path" VARCHAR,
"source_type" VARCHAR,
"target_table" VARCHAR,
"target_path" VARCHAR,
"target_type" VARCHAR
)[] |
Show child fields- mapping[]
Show child fields- mapping[].source_path
The source path. - mapping[].source_table
The name of the source table. - mapping[].source_type
The source type. - mapping[].target_path
The target path. - mapping[].target_table
The target table. - mapping[].target_type
The target type.
|
source Required Input Column
The source table. | STRUCT(
"database_name" VARCHAR,
"table_name" VARCHAR
) |
Show child fields- source.database_name
The database in which the table metadata resides. - source.table_name
The name of the table in question.
|
additional_plan_options_map Input Column
A map to hold additional optional key-value parameters. Currently, these key-value pairs are supported: -
inferSchema — Specifies whether to set inferSchema to true or false for the default script generated by an Glue job. For example, to set inferSchema to true, pass the following key value pair: --additional-plan-options-map '{"inferSchema":"true"}' | MAP(VARCHAR, VARCHAR) |
language Input Column
The programming language of the code to perform the mapping. | VARCHAR |
location Input Column
The parameters for the mapping. | STRUCT(
"jdbc" STRUCT(
"name" VARCHAR,
"value" VARCHAR,
"param" BOOLEAN
)[],
"s3" STRUCT(
"name" VARCHAR,
"value" VARCHAR,
"param" BOOLEAN
)[],
"dynamo_db" STRUCT(
"name" VARCHAR,
"value" VARCHAR,
"param" BOOLEAN
)[]
) |
Show child fields- location.dynamo_db[]
Show child fields- location.dynamo_db[].name
The name of the argument or property. - location.dynamo_db[].param
True if the value is used as a parameter. - location.dynamo_db[].value
The value of the argument or property.
- location.jdbc[]
Show child fields- location.jdbc[].name
The name of the argument or property. - location.jdbc[].param
True if the value is used as a parameter. - location.jdbc[].value
The value of the argument or property.
- location.s3[]
Show child fields- location.s3[].name
The name of the argument or property. - location.s3[].param
True if the value is used as a parameter. - location.s3[].value
The value of the argument or property.
|
sinks Input Column
The target tables. | STRUCT(
"database_name" VARCHAR,
"table_name" VARCHAR
)[] |
Show child fields- sinks[]
Show child fields- sinks[].database_name
The database in which the table metadata resides. - sinks[].table_name
The name of the table in question.
|
_aws_profile Input Column
The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role. | STRUCT(
"type" VARCHAR,
"name" VARCHAR,
"account_id" VARCHAR,
"via_profile_name" VARCHAR,
"assumed_role_arn" VARCHAR,
"organization" STRUCT(
"account_name" VARCHAR,
"id" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[],
"master_account" STRUCT(
"id" VARCHAR,
"email" VARCHAR
),
"parents" STRUCT(
"type" VARCHAR,
"id" VARCHAR,
"name" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[]
)[]
)
) |
Show child fields- _aws_profile.account_id
The AWS account id - _aws_profile.assumed_role_arn
The ARN of the assumed role - _aws_profile.name
The unique name of the profile. - _aws_profile.organization
Information about this profile's membership in the AWS organization. Show child fields- _aws_profile.organization.account_name
The name of account speciifed by the organization - _aws_profile.organization.id
The organization id - _aws_profile.organization.master_account
Show child fields- _aws_profile.organization.master_account.email
The organization master account email address - _aws_profile.organization.master_account.id
The organization master account id
- _aws_profile.organization.parents[]
Show child fields- _aws_profile.organization.parents[].id
The id of the parent - _aws_profile.organization.parents[].name
The name of the parent - _aws_profile.organization.parents[].tags[]
Show child fields- _aws_profile.organization.parents[].tags[].key
- _aws_profile.organization.parents[].tags[].value
- _aws_profile.organization.parents[].type
The type of parent can be an organization unit or a root
- _aws_profile.organization.tags[]
Show child fields- _aws_profile.organization.tags[].key
- _aws_profile.organization.tags[].value
- _aws_profile.type
The type of profile, either 'credentials' or 'assumed_role' - _aws_profile.via_profile_name
This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.
|
_aws_region Input Column
The AWS region to use. | VARCHAR |
python_script
A Python script to perform the mapping. | VARCHAR |
scala_code
The Scala code to perform the mapping. | VARCHAR |