Skip to content
AWS for Query.Farm

aws.datasync.describe_location_hdfs

Example SQL Queries

SELECT * FROM
aws.datasync.describe_location_hdfs
WHERE
"location_arn" = 'VALUE';

Description

Provides details about how an DataSync transfer location for a Hadoop Distributed File System (HDFS) is configured.

Table Definition

Column NameColumn Data Type
location_arn Required Input Column

The ARN of the HDFS location.

VARCHAR
_aws_profile Input Column

The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role.

STRUCT(
    "type" VARCHAR,
    "name" VARCHAR,
    "account_id" VARCHAR,
    "via_profile_name" VARCHAR,
    "assumed_role_arn" VARCHAR,
    "organization" STRUCT(
        "account_name" VARCHAR,
        "id" VARCHAR,
        "tags" STRUCT(
            "key" VARCHAR,
            "value" VARCHAR
        )[],
        "master_account" STRUCT(
            "id" VARCHAR,
            "email" VARCHAR
        ),
        "parents" STRUCT(
            "type" VARCHAR,
            "id" VARCHAR,
            "name" VARCHAR,
            "tags" STRUCT(
                "key" VARCHAR,
                "value" VARCHAR
            )[]
        )[]
    )
)
Show child fields
_aws_profile.account_id

The AWS account id

_aws_profile.assumed_role_arn

The ARN of the assumed role

_aws_profile.name

The unique name of the profile.

_aws_profile.organization

Information about this profile's membership in the AWS organization.

Show child fields
_aws_profile.organization.account_name

The name of account speciifed by the organization

_aws_profile.organization.id

The organization id

_aws_profile.organization.master_account
Show child fields
_aws_profile.organization.master_account.email

The organization master account email address

_aws_profile.organization.master_account.id

The organization master account id

_aws_profile.organization.parents[]
Show child fields
_aws_profile.organization.parents[].id

The id of the parent

_aws_profile.organization.parents[].name

The name of the parent

_aws_profile.organization.parents[].tags[]
Show child fields
_aws_profile.organization.parents[].tags[].key
_aws_profile.organization.parents[].tags[].value
_aws_profile.organization.parents[].type

The type of parent can be an organization unit or a root

_aws_profile.organization.tags[]
Show child fields
_aws_profile.organization.tags[].key
_aws_profile.organization.tags[].value
_aws_profile.type

The type of profile, either 'credentials' or 'assumed_role'

_aws_profile.via_profile_name

This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.

_aws_region Input Column

The AWS region to use.

VARCHAR
agent_arns

The ARNs of the DataSync agents that can connect with your HDFS cluster.

VARCHAR[]
Show child fields
agent_arns[]
authentication_type

The type of authentication used to determine the identity of the user. 

VARCHAR
block_size

The size of the data blocks to write into the HDFS cluster. 

BIGINT
creation_time

The time that the HDFS location was created.

TIMESTAMP_S
kerberos_principal

The Kerberos principal with access to the files and folders on the HDFS cluster. This parameter is used if the AuthenticationType is defined as KERBEROS.

VARCHAR
kms_key_provider_uri

The URI of the HDFS cluster's Key Management Server (KMS). 

VARCHAR
location_uri

The URI of the HDFS location.

VARCHAR
name_nodes

The NameNode that manages the HDFS namespace. 

STRUCT(
    "hostname" VARCHAR,
    "port" BIGINT
)[]
Show child fields
name_nodes[]
Show child fields
name_nodes[].hostname

The hostname of the NameNode in the HDFS cluster. This value is the IP address or Domain Name Service (DNS) name of the NameNode. An agent that's installed on-premises uses this hostname to communicate with the NameNode in the network.

name_nodes[].port

The port that the NameNode uses to listen to client requests.

qop_configuration

The Quality of Protection (QOP) configuration, which specifies the Remote Procedure Call (RPC) and data transfer protection settings configured on the HDFS cluster. 

STRUCT(
    "rpc_protection" VARCHAR,
    "data_transfer_protection" VARCHAR
)
Show child fields
qop_configuration.data_transfer_protection

The data transfer protection setting configured on the HDFS cluster. This setting corresponds to your dfs.data.transfer.protection setting in the hdfs-site.xml file on your Hadoop cluster.

qop_configuration.rpc_protection

The RPC protection setting configured on the HDFS cluster. This setting corresponds to your hadoop.rpc.protection setting in your core-site.xml file on your Hadoop cluster.

replication_factor

The number of DataNodes to replicate the data to when writing to the HDFS cluster. 

BIGINT
simple_user

The user name to identify the client on the host operating system. This parameter is used if the AuthenticationType is defined as SIMPLE.

VARCHAR