Skip to content

aws.glue.get_ml_task_runs

Example SQL Queries

SELECT * FROM
aws.glue.get_ml_task_runs
WHERE
"transform_id" = 'VALUE';

Description

Gets a list of runs for a machine learning transform. Machine learning task runs are asynchronous tasks that Glue runs on your behalf as part of various machine learning workflows. You can get a sortable, filterable list of machine learning task runs by calling GetMLTaskRuns with their parent transform's TransformID and other optional parameters as documented in this section.

This operation returns a list of historic runs and must be paginated.

Table Definition

Column NameColumn Data Type
transform_id Required Input Column

The unique identifier of the machine learning transform.

VARCHAR
filter Input Column

The filter criteria, in the TaskRunFilterCriteria structure, for the task run.

STRUCT(
"task_run_type" VARCHAR,
"status" VARCHAR,
"started_before" TIMESTAMP_S,
"started_after" TIMESTAMP_S
)
Show child fields
filter.started_after

Filter on task runs started after this date.

filter.started_before

Filter on task runs started before this date.

filter.status

The current status of the task run.

filter.task_run_type

The type of task run.

max_results Input Column

The maximum number of results to return.

BIGINT
next_token Input Column

A pagination token, if more results are available.

VARCHAR
sort Input Column

The sorting criteria, in the TaskRunSortCriteria structure, for the task run.

STRUCT(
"column" VARCHAR,
"sort_direction" VARCHAR
)
Show child fields
sort.column

The column to be used to sort the list of task runs for the machine learning transform.

sort.sort_direction

The sort direction to be used to sort the list of task runs for the machine learning transform.

_aws_profile Input Column

The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role.

STRUCT(
"type" VARCHAR,
"name" VARCHAR,
"account_id" VARCHAR,
"via_profile_name" VARCHAR,
"assumed_role_arn" VARCHAR,
"organization" STRUCT(
"account_name" VARCHAR,
"id" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[],
"master_account" STRUCT(
"id" VARCHAR,
"email" VARCHAR
),
"parents" STRUCT(
"type" VARCHAR,
"id" VARCHAR,
"name" VARCHAR,
"tags" STRUCT(
"key" VARCHAR,
"value" VARCHAR
)[]
)[]
)
)
Show child fields
_aws_profile.account_id

The AWS account id

_aws_profile.assumed_role_arn

The ARN of the assumed role

_aws_profile.name

The unique name of the profile.

_aws_profile.organization

Information about this profile's membership in the AWS organization.

Show child fields
_aws_profile.organization.account_name

The name of account speciifed by the organization

_aws_profile.organization.id

The organization id

_aws_profile.organization.master_account
Show child fields
_aws_profile.organization.master_account.email

The organization master account email address

_aws_profile.organization.master_account.id

The organization master account id

_aws_profile.organization.parents[]
Show child fields
_aws_profile.organization.parents[].id

The id of the parent

_aws_profile.organization.parents[].name

The name of the parent

_aws_profile.organization.parents[].tags[]
Show child fields
_aws_profile.organization.parents[].tags[].key
_aws_profile.organization.parents[].tags[].value
_aws_profile.organization.parents[].type

The type of parent can be an organization unit or a root

_aws_profile.organization.tags[]
Show child fields
_aws_profile.organization.tags[].key
_aws_profile.organization.tags[].value
_aws_profile.type

The type of profile, either 'credentials' or 'assumed_role'

_aws_profile.via_profile_name

This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.

_aws_region Input Column

The AWS region to use.

VARCHAR
task_runs

A list of task runs that are associated with the transform.

STRUCT(
"transform_id" VARCHAR,
"task_run_id" VARCHAR,
"status" VARCHAR,
"log_group_name" VARCHAR,
"properties" STRUCT(
"task_type" VARCHAR,
"import_labels_task_run_properties" STRUCT(
"input_s3_path" VARCHAR,
"replace" BOOLEAN
),
"export_labels_task_run_properties" STRUCT(
"output_s3_path" VARCHAR
),
"labeling_set_generation_task_run_properties" STRUCT(
"output_s3_path" VARCHAR
),
"find_matches_task_run_properties" STRUCT(
"job_id" VARCHAR,
"job_name" VARCHAR,
"job_run_id" VARCHAR
)
),
"error_string" VARCHAR,
"started_on" TIMESTAMP_S,
"last_modified_on" TIMESTAMP_S,
"completed_on" TIMESTAMP_S,
"execution_time" BIGINT
)[]
Show child fields
task_runs[]
Show child fields
task_runs[].completed_on

The last point in time that the requested task run was completed.

task_runs[].error_string

The list of error strings associated with this task run.

task_runs[].execution_time

The amount of time (in seconds) that the task run consumed resources.

task_runs[].last_modified_on

The last point in time that the requested task run was updated.

task_runs[].log_group_name

The names of the log group for secure logging, associated with this task run.

task_runs[].properties

Specifies configuration properties associated with this task run.

Show child fields
task_runs[].properties.export_labels_task_run_properties

The configuration properties for an exporting labels task run.

Show child fields
task_runs[].properties.export_labels_task_run_properties.output_s3_path

The Amazon Simple Storage Service (Amazon S3) path where you will export the labels.

task_runs[].properties.find_matches_task_run_properties

The configuration properties for a find matches task run.

Show child fields
task_runs[].properties.find_matches_task_run_properties.job_id

The job ID for the Find Matches task run.

task_runs[].properties.find_matches_task_run_properties.job_name

The name assigned to the job for the Find Matches task run.

task_runs[].properties.find_matches_task_run_properties.job_run_id

The job run ID for the Find Matches task run.

task_runs[].properties.import_labels_task_run_properties

The configuration properties for an importing labels task run.

Show child fields
task_runs[].properties.import_labels_task_run_properties.input_s3_path

The Amazon Simple Storage Service (Amazon S3) path from where you will import the labels.

task_runs[].properties.import_labels_task_run_properties.replace

Indicates whether to overwrite your existing labels.

task_runs[].properties.labeling_set_generation_task_run_properties

The configuration properties for a labeling set generation task run.

Show child fields
task_runs[].properties.labeling_set_generation_task_run_properties.output_s3_path

The Amazon Simple Storage Service (Amazon S3) path where you will generate the labeling set.

task_runs[].properties.task_type

The type of task run.

task_runs[].started_on

The date and time that this task run started.

task_runs[].status

The current status of the requested task run.

task_runs[].task_run_id

The unique identifier for this task run.

task_runs[].transform_id

The unique identifier for the transform.