_aws_profile Input Column
The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role. | STRUCT( "type" VARCHAR, "name" VARCHAR, "account_id" VARCHAR, "via_profile_name" VARCHAR, "assumed_role_arn" VARCHAR, "organization" STRUCT( "account_name" VARCHAR, "id" VARCHAR, "tags" STRUCT( "key" VARCHAR, "value" VARCHAR )[], "master_account" STRUCT( "id" VARCHAR, "email" VARCHAR ), "parents" STRUCT( "type" VARCHAR, "id" VARCHAR, "name" VARCHAR, "tags" STRUCT( "key" VARCHAR, "value" VARCHAR )[] )[] ) ) |
classifier
The requested classifier. | STRUCT( "grok_classifier" STRUCT( "name" VARCHAR, "classification" VARCHAR, "creation_time" TIMESTAMP_S, "last_updated" TIMESTAMP_S, "version" BIGINT, "grok_pattern" VARCHAR, "custom_patterns" VARCHAR ), "xml_classifier" STRUCT( "name" VARCHAR, "classification" VARCHAR, "creation_time" TIMESTAMP_S, "last_updated" TIMESTAMP_S, "version" BIGINT, "row_tag" VARCHAR ), "json_classifier" STRUCT( "name" VARCHAR, "creation_time" TIMESTAMP_S, "last_updated" TIMESTAMP_S, "version" BIGINT, "json_path" VARCHAR ), "csv_classifier" STRUCT( "name" VARCHAR, "creation_time" TIMESTAMP_S, "last_updated" TIMESTAMP_S, "version" BIGINT, "delimiter" VARCHAR, "quote_symbol" VARCHAR, "contains_header" VARCHAR, "header" VARCHAR[], "disable_value_trimming" BOOLEAN, "allow_single_column" BOOLEAN, "custom_datatype_configured" BOOLEAN, "custom_datatypes" VARCHAR[], "serde" VARCHAR ) ) |
Show child fields- classifier.csv_classifier
A classifier for comma-separated values (CSV). Show child fields- classifier.csv_classifier.allow_single_column
Enables the processing of files that contain only one column.
- classifier.csv_classifier.contains_header
Indicates whether the CSV file contains a header.
- classifier.csv_classifier.creation_time
The time that this classifier was registered.
- classifier.csv_classifier.custom_datatype_configured
Enables the custom datatype to be configured.
- classifier.csv_classifier.custom_datatypes[]
- classifier.csv_classifier.delimiter
A custom symbol to denote what separates each column entry in the row.
- classifier.csv_classifier.disable_value_trimming
Specifies not to trim values before identifying the type of column values. The default value is true.
- classifier.csv_classifier.header[]
- classifier.csv_classifier.last_updated
The time that this classifier was last updated.
- classifier.csv_classifier.name
The name of the classifier.
- classifier.csv_classifier.quote_symbol
A custom symbol to denote what combines content into a single column value. It must be different from the column delimiter.
- classifier.csv_classifier.serde
Sets the SerDe for processing CSV in the classifier, which will be applied in the Data Catalog. Valid values are OpenCSVSerDe, LazySimpleSerDe, and None. You can specify the None value when you want the crawler to do the detection.
- classifier.csv_classifier.version
The version of this classifier.
- classifier.grok_classifier
A classifier that uses grok. Show child fields- classifier.grok_classifier.classification
An identifier of the data format that the classifier matches, such as Twitter, JSON, Omniture logs, and so on.
- classifier.grok_classifier.creation_time
The time that this classifier was registered.
- classifier.grok_classifier.custom_patterns
Optional custom grok patterns defined by this classifier. For more information, see custom patterns in Writing Custom Classifiers.
- classifier.grok_classifier.grok_pattern
The grok pattern applied to a data store by this classifier. For more information, see built-in patterns in Writing Custom Classifiers.
- classifier.grok_classifier.last_updated
The time that this classifier was last updated.
- classifier.grok_classifier.name
The name of the classifier.
- classifier.grok_classifier.version
The version of this classifier.
- classifier.json_classifier
A classifier for JSON content. Show child fields- classifier.json_classifier.creation_time
The time that this classifier was registered.
- classifier.json_classifier.json_path
A JsonPath string defining the JSON data for the classifier to classify. Glue supports a subset of JsonPath, as described in Writing JsonPath Custom Classifiers.
- classifier.json_classifier.last_updated
The time that this classifier was last updated.
- classifier.json_classifier.name
The name of the classifier.
- classifier.json_classifier.version
The version of this classifier.
- classifier.xml_classifier
A classifier for XML content. Show child fields- classifier.xml_classifier.classification
An identifier of the data format that the classifier matches.
- classifier.xml_classifier.creation_time
The time that this classifier was registered.
- classifier.xml_classifier.last_updated
The time that this classifier was last updated.
- classifier.xml_classifier.name
The name of the classifier.
- classifier.xml_classifier.row_tag
The XML tag designating the element that contains each record in an XML document being parsed. This can't identify a self-closing element (closed by />). An empty row element that contains only attributes can be parsed as long as it ends with a closing tag (for example, <row item_a="A" item_b="B"></row> is okay, but <row item_a="A" item_b="B" /> is not).
- classifier.xml_classifier.version
The version of this classifier.
|