Skip to content
AWS for Query.Farm

aws.appflow.describe_flow_execution_records

Example SQL Queries

SELECT * FROM
aws.appflow.describe_flow_execution_records
WHERE
"flow_name" = 'VALUE';

Description

Fetches the execution history of the flow.

Table Definition

Column NameColumn Data Type
flow_name Required Input Column

The specified name of the flow. Spaces are not allowed. Use underscores (_) or hyphens (-) only. 

VARCHAR
max_results Input Column

Specifies the maximum number of items that should be returned in the result set. The default for maxResults is 20 (for all paginated API operations). 

BIGINT
next_token Input Column

The pagination token for the next page of data. 

VARCHAR
_aws_profile Input Column

The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role.

STRUCT(
    "type" VARCHAR,
    "name" VARCHAR,
    "account_id" VARCHAR,
    "via_profile_name" VARCHAR,
    "assumed_role_arn" VARCHAR,
    "organization" STRUCT(
        "account_name" VARCHAR,
        "id" VARCHAR,
        "tags" STRUCT(
            "key" VARCHAR,
            "value" VARCHAR
        )[],
        "master_account" STRUCT(
            "id" VARCHAR,
            "email" VARCHAR
        ),
        "parents" STRUCT(
            "type" VARCHAR,
            "id" VARCHAR,
            "name" VARCHAR,
            "tags" STRUCT(
                "key" VARCHAR,
                "value" VARCHAR
            )[]
        )[]
    )
)
Show child fields
_aws_profile.account_id

The AWS account id

_aws_profile.assumed_role_arn

The ARN of the assumed role

_aws_profile.name

The unique name of the profile.

_aws_profile.organization

Information about this profile's membership in the AWS organization.

Show child fields
_aws_profile.organization.account_name

The name of account speciifed by the organization

_aws_profile.organization.id

The organization id

_aws_profile.organization.master_account
Show child fields
_aws_profile.organization.master_account.email

The organization master account email address

_aws_profile.organization.master_account.id

The organization master account id

_aws_profile.organization.parents[]
Show child fields
_aws_profile.organization.parents[].id

The id of the parent

_aws_profile.organization.parents[].name

The name of the parent

_aws_profile.organization.parents[].tags[]
Show child fields
_aws_profile.organization.parents[].tags[].key
_aws_profile.organization.parents[].tags[].value
_aws_profile.organization.parents[].type

The type of parent can be an organization unit or a root

_aws_profile.organization.tags[]
Show child fields
_aws_profile.organization.tags[].key
_aws_profile.organization.tags[].value
_aws_profile.type

The type of profile, either 'credentials' or 'assumed_role'

_aws_profile.via_profile_name

This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.

_aws_region Input Column

The AWS region to use.

VARCHAR
flow_executions

Returns a list of all instances when this flow was run. 

STRUCT(
    "execution_id" VARCHAR,
    "execution_status" VARCHAR,
    "execution_result" STRUCT(
        "error_info" STRUCT(
            "put_failures_count" BIGINT,
            "execution_message" VARCHAR
        ),
        "bytes_processed" BIGINT,
        "bytes_written" BIGINT,
        "records_processed" BIGINT,
        "num_parallel_processes" BIGINT,
        "max_page_size" BIGINT
    ),
    "started_at" TIMESTAMP_S,
    "last_updated_at" TIMESTAMP_S,
    "data_pull_start_time" TIMESTAMP_S,
    "data_pull_end_time" TIMESTAMP_S,
    "metadata_catalog_details" STRUCT(
        "catalog_type" VARCHAR,
        "table_name" VARCHAR,
        "table_registration_output" STRUCT(
            "message" VARCHAR,
            "result" VARCHAR,
            "status" VARCHAR
        ),
        "partition_registration_output" STRUCT(
            "message" VARCHAR,
            "result" VARCHAR,
            "status" VARCHAR
        )
    )[]
)[]
Show child fields
flow_executions[]
Show child fields
flow_executions[].data_pull_end_time

The timestamp that indicates the last new or updated record to be transferred in the flow run.

flow_executions[].data_pull_start_time

The timestamp that determines the first new or updated record to be transferred in the flow run.

flow_executions[].execution_id

Specifies the identifier of the given flow run.

flow_executions[].execution_result

Describes the result of the given flow run.

Show child fields
flow_executions[].execution_result.bytes_processed

The total number of bytes processed by the flow run.

flow_executions[].execution_result.bytes_written

The total number of bytes written as a result of the flow run.

flow_executions[].execution_result.error_info

Provides any error message information related to the flow run.

Show child fields
flow_executions[].execution_result.error_info.execution_message

Specifies the error message that appears if a flow fails.

flow_executions[].execution_result.error_info.put_failures_count

Specifies the failure count for the attempted flow.

flow_executions[].execution_result.max_page_size

The maximum number of records that Amazon AppFlow receives in each page of the response from your SAP application.

flow_executions[].execution_result.num_parallel_processes

The number of processes that Amazon AppFlow ran at the same time when it retrieved your data.

flow_executions[].execution_result.records_processed

The number of records processed in the flow run.

flow_executions[].execution_status

Specifies the flow run status and whether it is in progress, has completed successfully, or has failed.

flow_executions[].last_updated_at

Specifies the time of the most recent update.

flow_executions[].metadata_catalog_details[]
Show child fields
flow_executions[].metadata_catalog_details[].catalog_type

The type of metadata catalog that Amazon AppFlow used for the associated flow run. This parameter returns the following value:

GLUE

The metadata catalog is provided by the Glue Data Catalog. Glue includes the Glue Data Catalog as a component.

flow_executions[].metadata_catalog_details[].partition_registration_output

Describes the status of the attempt from Amazon AppFlow to register the data partitions with the metadata catalog. The data partitions organize the flow output into a hierarchical path, such as a folder path in an S3 bucket. Amazon AppFlow creates the partitions (if they don't already exist) based on your flow configuration.

Show child fields
flow_executions[].metadata_catalog_details[].partition_registration_output.message

Explains the status of the registration attempt from Amazon AppFlow. If the attempt fails, the message explains why.

flow_executions[].metadata_catalog_details[].partition_registration_output.result

Indicates the number of resources that Amazon AppFlow created or updated. Possible resources include metadata tables and data partitions.

flow_executions[].metadata_catalog_details[].partition_registration_output.status

Indicates the status of the registration attempt from Amazon AppFlow.

flow_executions[].metadata_catalog_details[].table_name

The name of the table that stores the metadata for the associated flow run. The table stores metadata that represents the data that the flow transferred. Amazon AppFlow stores the table in the metadata catalog.

flow_executions[].metadata_catalog_details[].table_registration_output

Describes the status of the attempt from Amazon AppFlow to register the metadata table with the metadata catalog. Amazon AppFlow creates or updates this table for the associated flow run.

Show child fields
flow_executions[].metadata_catalog_details[].table_registration_output.message

Explains the status of the registration attempt from Amazon AppFlow. If the attempt fails, the message explains why.

flow_executions[].metadata_catalog_details[].table_registration_output.result

Indicates the number of resources that Amazon AppFlow created or updated. Possible resources include metadata tables and data partitions.

flow_executions[].metadata_catalog_details[].table_registration_output.status

Indicates the status of the registration attempt from Amazon AppFlow.

flow_executions[].started_at

Specifies the start time of the flow run.