| Column Name | Column Data Type |
|---|
_aws_profile Input Column
The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role. | STRUCT(
"type" VARCHAR,
"name" VARCHAR,
"account_id" VARCHAR,
"via_profile_name" VARCHAR,
"assumed_role_arn" VARCHAR,
"organization" STRUCT(
"account_name" VARCHAR,
"id" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[],
"master_account" STRUCT(
"id" VARCHAR,
"email" VARCHAR
),
"parents" STRUCT(
"type" VARCHAR,
"id" VARCHAR,
"name" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[]
)[]
)
) |
Show child fields- _aws_profile.account_id
The AWS account id - _aws_profile.assumed_role_arn
The ARN of the assumed role - _aws_profile.name
The unique name of the profile. - _aws_profile.organization
Information about this profile's membership in the AWS organization. Show child fields- _aws_profile.organization.account_name
The name of account speciifed by the organization - _aws_profile.organization.id
The organization id - _aws_profile.organization.master_account
Show child fields- _aws_profile.organization.master_account.email
The organization master account email address - _aws_profile.organization.master_account.id
The organization master account id
- _aws_profile.organization.parents[]
Show child fields- _aws_profile.organization.parents[].id
The id of the parent - _aws_profile.organization.parents[].name
The name of the parent - _aws_profile.organization.parents[].tags[]
Show child fields- _aws_profile.organization.parents[].tags[].key
- _aws_profile.organization.parents[].tags[].value
- _aws_profile.organization.parents[].type
The type of parent can be an organization unit or a root
- _aws_profile.organization.tags[]
Show child fields- _aws_profile.organization.tags[].key
- _aws_profile.organization.tags[].value
- _aws_profile.type
The type of profile, either 'credentials' or 'assumed_role' - _aws_profile.via_profile_name
This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.
|
_aws_region Input Column
The AWS region to use. | VARCHAR |
csv_classifier
A classifier for comma-separated values (CSV). | STRUCT(
"name" VARCHAR,
"creation_time" TIMESTAMP_S,
"last_updated" TIMESTAMP_S,
"version" BIGINT,
"delimiter" VARCHAR,
"quote_symbol" VARCHAR,
"contains_header" VARCHAR,
"header" VARCHAR[],
"disable_value_trimming" BOOLEAN,
"allow_single_column" BOOLEAN,
"custom_datatype_configured" BOOLEAN,
"custom_datatypes" VARCHAR[],
"serde" VARCHAR
) |
Show child fields- csv_classifier.allow_single_column
Enables the processing of files that contain only one column. - csv_classifier.contains_header
Indicates whether the CSV file contains a header. - csv_classifier.creation_time
The time that this classifier was registered. - csv_classifier.custom_datatype_configured
Enables the custom datatype to be configured. - csv_classifier.custom_datatypes[]
- csv_classifier.delimiter
A custom symbol to denote what separates each column entry in the row. - csv_classifier.disable_value_trimming
Specifies not to trim values before identifying the type of column values. The default value is true. - csv_classifier.header[]
- csv_classifier.last_updated
The time that this classifier was last updated. - csv_classifier.name
The name of the classifier. - csv_classifier.quote_symbol
A custom symbol to denote what combines content into a single column value. It must be different from the column delimiter. - csv_classifier.serde
Sets the SerDe for processing CSV in the classifier, which will be applied in the Data Catalog. Valid values are OpenCSVSerDe, LazySimpleSerDe, and None. You can specify the None value when you want the crawler to do the detection. - csv_classifier.version
The version of this classifier.
|
grok_classifier
A classifier that uses grok. | STRUCT(
"name" VARCHAR,
"classification" VARCHAR,
"creation_time" TIMESTAMP_S,
"last_updated" TIMESTAMP_S,
"version" BIGINT,
"grok_pattern" VARCHAR,
"custom_patterns" VARCHAR
) |
Show child fields- grok_classifier.classification
An identifier of the data format that the classifier matches, such as Twitter, JSON, Omniture logs, and so on. - grok_classifier.creation_time
The time that this classifier was registered. - grok_classifier.custom_patterns
Optional custom grok patterns defined by this classifier. For more information, see custom patterns in Writing Custom Classifiers. - grok_classifier.grok_pattern
The grok pattern applied to a data store by this classifier. For more information, see built-in patterns in Writing Custom Classifiers. - grok_classifier.last_updated
The time that this classifier was last updated. - grok_classifier.name
The name of the classifier. - grok_classifier.version
The version of this classifier.
|
json_classifier
A classifier for JSON content. | STRUCT(
"name" VARCHAR,
"creation_time" TIMESTAMP_S,
"last_updated" TIMESTAMP_S,
"version" BIGINT,
"json_path" VARCHAR
) |
Show child fields- json_classifier.creation_time
The time that this classifier was registered. - json_classifier.json_path
A JsonPath string defining the JSON data for the classifier to classify. Glue supports a subset of JsonPath, as described in Writing JsonPath Custom Classifiers. - json_classifier.last_updated
The time that this classifier was last updated. - json_classifier.name
The name of the classifier. - json_classifier.version
The version of this classifier.
|
xml_classifier
A classifier for XML content. | STRUCT(
"name" VARCHAR,
"classification" VARCHAR,
"creation_time" TIMESTAMP_S,
"last_updated" TIMESTAMP_S,
"version" BIGINT,
"row_tag" VARCHAR
) |
Show child fields- xml_classifier.classification
An identifier of the data format that the classifier matches. - xml_classifier.creation_time
The time that this classifier was registered. - xml_classifier.last_updated
The time that this classifier was last updated. - xml_classifier.name
The name of the classifier. - xml_classifier.row_tag
The XML tag designating the element that contains each record in an XML document being parsed. This can't identify a self-closing element (closed by />). An empty row element that contains only attributes can be parsed as long as it ends with a closing tag (for example, <row item_a="A" item_b="B"></row> is okay, but <row item_a="A" item_b="B" /> is not). - xml_classifier.version
The version of this classifier.
|