Skip to content
AWS for Query.Farm

aws.sagemaker.list_pipeline_execution_steps

Example SQL Queries

SELECT * FROM
aws.sagemaker.list_pipeline_execution_steps;

Description

Gets a list of PipeLineExecutionStep objects.

Table Definition

Column NameColumn Data Type
pipeline_execution_arn Input Column

The Amazon Resource Name (ARN) of the pipeline execution.

VARCHAR
sort_order Input Column

The field by which to sort results. The default is CreatedTime.

VARCHAR
_aws_profile Input Column

The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role.

STRUCT(
    "type" VARCHAR,
    "name" VARCHAR,
    "account_id" VARCHAR,
    "via_profile_name" VARCHAR,
    "assumed_role_arn" VARCHAR,
    "organization" STRUCT(
        "account_name" VARCHAR,
        "id" VARCHAR,
        "tags" STRUCT(
            "key" VARCHAR,
            "value" VARCHAR
        )[],
        "master_account" STRUCT(
            "id" VARCHAR,
            "email" VARCHAR
        ),
        "parents" STRUCT(
            "type" VARCHAR,
            "id" VARCHAR,
            "name" VARCHAR,
            "tags" STRUCT(
                "key" VARCHAR,
                "value" VARCHAR
            )[]
        )[]
    )
)
Show child fields
_aws_profile.account_id

The AWS account id

_aws_profile.assumed_role_arn

The ARN of the assumed role

_aws_profile.name

The unique name of the profile.

_aws_profile.organization

Information about this profile's membership in the AWS organization.

Show child fields
_aws_profile.organization.account_name

The name of account speciifed by the organization

_aws_profile.organization.id

The organization id

_aws_profile.organization.master_account
Show child fields
_aws_profile.organization.master_account.email

The organization master account email address

_aws_profile.organization.master_account.id

The organization master account id

_aws_profile.organization.parents[]
Show child fields
_aws_profile.organization.parents[].id

The id of the parent

_aws_profile.organization.parents[].name

The name of the parent

_aws_profile.organization.parents[].tags[]
Show child fields
_aws_profile.organization.parents[].tags[].key
_aws_profile.organization.parents[].tags[].value
_aws_profile.organization.parents[].type

The type of parent can be an organization unit or a root

_aws_profile.organization.tags[]
Show child fields
_aws_profile.organization.tags[].key
_aws_profile.organization.tags[].value
_aws_profile.type

The type of profile, either 'credentials' or 'assumed_role'

_aws_profile.via_profile_name

This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.

attempt_count

The current attempt of the execution step. For more information, see Retry Policy for SageMaker Pipelines steps.

BIGINT
cache_hit_result

If this pipeline execution step was cached, details on the cache hit.

STRUCT(
    "source_pipeline_execution_arn" VARCHAR
)
Show child fields
cache_hit_result.source_pipeline_execution_arn

The Amazon Resource Name (ARN) of the pipeline execution.

end_time

The time that the step stopped executing.

TIMESTAMP_S
failure_reason

The reason why the step failed execution. This is only returned if the step failed its execution.

VARCHAR
metadata

Metadata to run the pipeline step.

STRUCT(
    "training_job" STRUCT(
        "arn" VARCHAR
    ),
    "processing_job" STRUCT(
        "arn" VARCHAR
    ),
    "transform_job" STRUCT(
        "arn" VARCHAR
    ),
    "tuning_job" STRUCT(
        "arn" VARCHAR
    ),
    "model" STRUCT(
        "arn" VARCHAR
    ),
    "register_model" STRUCT(
        "arn" VARCHAR
    ),
    "condition" STRUCT(
        "outcome" VARCHAR
    ),
    "callback" STRUCT(
        "callback_token" VARCHAR,
        "sqs_queue_url" VARCHAR,
        "output_parameters" STRUCT(
            "name" VARCHAR,
            "value" VARCHAR
        )[]
    ),
    "lambda" STRUCT(
        "arn" VARCHAR,
        "output_parameters" STRUCT(
            "name" VARCHAR,
            "value" VARCHAR
        )[]
    ),
    "emr" STRUCT(
        "cluster_id" VARCHAR,
        "step_id" VARCHAR,
        "step_name" VARCHAR,
        "log_file_path" VARCHAR
    ),
    "quality_check" STRUCT(
        "check_type" VARCHAR,
        "baseline_used_for_drift_check_statistics" VARCHAR,
        "baseline_used_for_drift_check_constraints" VARCHAR,
        "calculated_baseline_statistics" VARCHAR,
        "calculated_baseline_constraints" VARCHAR,
        "model_package_group_name" VARCHAR,
        "violation_report" VARCHAR,
        "check_job_arn" VARCHAR,
        "skip_check" BOOLEAN,
        "register_new_baseline" BOOLEAN
    ),
    "clarify_check" STRUCT(
        "check_type" VARCHAR,
        "baseline_used_for_drift_check_constraints" VARCHAR,
        "calculated_baseline_constraints" VARCHAR,
        "model_package_group_name" VARCHAR,
        "violation_report" VARCHAR,
        "check_job_arn" VARCHAR,
        "skip_check" BOOLEAN,
        "register_new_baseline" BOOLEAN
    ),
    "fail" STRUCT(
        "error_message" VARCHAR
    ),
    "auto_ml_job" STRUCT(
        "arn" VARCHAR
    ),
    "endpoint" STRUCT(
        "arn" VARCHAR
    ),
    "endpoint_config" STRUCT(
        "arn" VARCHAR
    )
)
Show child fields
metadata.auto_ml_job

The Amazon Resource Name (ARN) of the AutoML job that was run by this step.

Show child fields
metadata.auto_ml_job.arn

The Amazon Resource Name (ARN) of the AutoML job.

metadata.callback

The URL of the Amazon SQS queue used by this step execution, the pipeline generated token, and a list of output parameters.

Show child fields
metadata.callback.callback_token

The pipeline generated token from the Amazon SQS queue.

metadata.callback.output_parameters[]
Show child fields
metadata.callback.output_parameters[].name

The name of the output parameter.

metadata.callback.output_parameters[].value

The value of the output parameter.

metadata.callback.sqs_queue_url

The URL of the Amazon Simple Queue Service (Amazon SQS) queue used by the callback step.

metadata.clarify_check

Container for the metadata for a Clarify check step. The configurations and outcomes of the check step execution. This includes:

  • The type of the check conducted,

  • The Amazon S3 URIs of baseline constraints and statistics files to be used for the drift check.

  • The Amazon S3 URIs of newly calculated baseline constraints and statistics.

  • The model package group name provided.

  • The Amazon S3 URI of the violation report if violations detected.

  • The Amazon Resource Name (ARN) of check processing job initiated by the step execution.

  • The boolean flags indicating if the drift check is skipped.

  • If step property BaselineUsedForDriftCheck is set the same as CalculatedBaseline.

Show child fields
metadata.clarify_check.baseline_used_for_drift_check_constraints

The Amazon S3 URI of baseline constraints file to be used for the drift check.

metadata.clarify_check.calculated_baseline_constraints

The Amazon S3 URI of the newly calculated baseline constraints file.

metadata.clarify_check.check_job_arn

The Amazon Resource Name (ARN) of the check processing job that was run by this step's execution.

metadata.clarify_check.check_type

The type of the Clarify Check step

metadata.clarify_check.model_package_group_name

The model package group name.

metadata.clarify_check.register_new_baseline

This flag indicates if a newly calculated baseline can be accessed through step properties BaselineUsedForDriftCheckConstraints and BaselineUsedForDriftCheckStatistics. If it is set to False, the previous baseline of the configured check type must also be available. These can be accessed through the BaselineUsedForDriftCheckConstraints property.

metadata.clarify_check.skip_check

This flag indicates if the drift check against the previous baseline will be skipped or not. If it is set to False, the previous baseline of the configured check type must be available.

metadata.clarify_check.violation_report

The Amazon S3 URI of the violation report if violations are detected.

metadata.condition

The outcome of the condition evaluation that was run by this step execution.

Show child fields
metadata.condition.outcome

The outcome of the Condition step evaluation.

metadata.emr

The configurations and outcomes of an Amazon EMR step execution.

Show child fields
metadata.emr.cluster_id

The identifier of the EMR cluster.

metadata.emr.log_file_path

The path to the log file where the cluster step's failure root cause is recorded.

metadata.emr.step_id

The identifier of the EMR cluster step.

metadata.emr.step_name

The name of the EMR cluster step.

metadata.endpoint

The endpoint that was invoked during this step execution.

Show child fields
metadata.endpoint.arn

The Amazon Resource Name (ARN) of the endpoint in the step.

metadata.endpoint_config

The endpoint configuration used to create an endpoint during this step execution.

Show child fields
metadata.endpoint_config.arn

The Amazon Resource Name (ARN) of the endpoint configuration used in the step.

metadata.fail

The configurations and outcomes of a Fail step execution.

Show child fields
metadata.fail.error_message

A message that you define and then is processed and rendered by the Fail step when the error occurs.

metadata.lambda

The Amazon Resource Name (ARN) of the Lambda function that was run by this step execution and a list of output parameters.

Show child fields
metadata.lambda.arn

The Amazon Resource Name (ARN) of the Lambda function that was run by this step execution.

metadata.lambda.output_parameters[]
Show child fields
metadata.lambda.output_parameters[].name

The name of the output parameter.

metadata.lambda.output_parameters[].value

The value of the output parameter.

metadata.model

The Amazon Resource Name (ARN) of the model that was created by this step execution.

Show child fields
metadata.model.arn

The Amazon Resource Name (ARN) of the created model.

metadata.processing_job

The Amazon Resource Name (ARN) of the processing job that was run by this step execution.

Show child fields
metadata.processing_job.arn

The Amazon Resource Name (ARN) of the processing job.

metadata.quality_check

The configurations and outcomes of the check step execution. This includes:

  • The type of the check conducted.

  • The Amazon S3 URIs of baseline constraints and statistics files to be used for the drift check.

  • The Amazon S3 URIs of newly calculated baseline constraints and statistics.

  • The model package group name provided.

  • The Amazon S3 URI of the violation report if violations detected.

  • The Amazon Resource Name (ARN) of check processing job initiated by the step execution.

  • The Boolean flags indicating if the drift check is skipped.

  • If step property BaselineUsedForDriftCheck is set the same as CalculatedBaseline.

Show child fields
metadata.quality_check.baseline_used_for_drift_check_constraints

The Amazon S3 URI of the baseline constraints file used for the drift check.

metadata.quality_check.baseline_used_for_drift_check_statistics

The Amazon S3 URI of the baseline statistics file used for the drift check.

metadata.quality_check.calculated_baseline_constraints

The Amazon S3 URI of the newly calculated baseline constraints file.

metadata.quality_check.calculated_baseline_statistics

The Amazon S3 URI of the newly calculated baseline statistics file.

metadata.quality_check.check_job_arn

The Amazon Resource Name (ARN) of the Quality check processing job that was run by this step execution.

metadata.quality_check.check_type

The type of the Quality check step.

metadata.quality_check.model_package_group_name

The model package group name.

metadata.quality_check.register_new_baseline

This flag indicates if a newly calculated baseline can be accessed through step properties BaselineUsedForDriftCheckConstraints and BaselineUsedForDriftCheckStatistics. If it is set to False, the previous baseline of the configured check type must also be available. These can be accessed through the BaselineUsedForDriftCheckConstraints and BaselineUsedForDriftCheckStatistics properties.

metadata.quality_check.skip_check

This flag indicates if the drift check against the previous baseline will be skipped or not. If it is set to False, the previous baseline of the configured check type must be available.

metadata.quality_check.violation_report

The Amazon S3 URI of violation report if violations are detected.

metadata.register_model

The Amazon Resource Name (ARN) of the model package that the model was registered to by this step execution.

Show child fields
metadata.register_model.arn

The Amazon Resource Name (ARN) of the model package.

metadata.training_job

The Amazon Resource Name (ARN) of the training job that was run by this step execution.

Show child fields
metadata.training_job.arn

The Amazon Resource Name (ARN) of the training job that was run by this step execution.

metadata.transform_job

The Amazon Resource Name (ARN) of the transform job that was run by this step execution.

Show child fields
metadata.transform_job.arn

The Amazon Resource Name (ARN) of the transform job that was run by this step execution.

metadata.tuning_job

The Amazon Resource Name (ARN) of the tuning job that was run by this step execution.

Show child fields
metadata.tuning_job.arn

The Amazon Resource Name (ARN) of the tuning job that was run by this step execution.

selective_execution_result

The ARN from an execution of the current pipeline from which results are reused for this step.

STRUCT(
    "source_pipeline_execution_arn" VARCHAR
)
Show child fields
selective_execution_result.source_pipeline_execution_arn

The ARN from an execution of the current pipeline.

start_time

The time that the step started executing.

TIMESTAMP_S
step_description

The description of the step.

VARCHAR
step_display_name

The display name of the step.

VARCHAR
step_name

The name of the step that is executed.

VARCHAR
step_status

The status of the step execution.

VARCHAR