Skip to content
AWS for Query.Farm

aws.sagemaker.list_inference_recommendations_job_steps

Example SQL Queries

SELECT * FROM
aws.sagemaker.list_inference_recommendations_job_steps
WHERE
"job_name" = 'VALUE';

Description

Returns a list of the subtasks for an Inference Recommender job.

The supported subtasks are benchmarks, which evaluate the performance of your model on different instance types.

Table Definition

Column NameColumn Data Type
job_name Required Input Column

The name of the Inference Recommender job.

VARCHAR
status Input Column

The current status of the benchmark.

VARCHAR
step_type Input Column

The type of the subtask.

BENCHMARK: Evaluate the performance of your model on different instance types.

VARCHAR
_aws_profile Input Column

The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role.

STRUCT(
    "type" VARCHAR,
    "name" VARCHAR,
    "account_id" VARCHAR,
    "via_profile_name" VARCHAR,
    "assumed_role_arn" VARCHAR,
    "organization" STRUCT(
        "account_name" VARCHAR,
        "id" VARCHAR,
        "tags" STRUCT(
            "key" VARCHAR,
            "value" VARCHAR
        )[],
        "master_account" STRUCT(
            "id" VARCHAR,
            "email" VARCHAR
        ),
        "parents" STRUCT(
            "type" VARCHAR,
            "id" VARCHAR,
            "name" VARCHAR,
            "tags" STRUCT(
                "key" VARCHAR,
                "value" VARCHAR
            )[]
        )[]
    )
)
Show child fields
_aws_profile.account_id

The AWS account id

_aws_profile.assumed_role_arn

The ARN of the assumed role

_aws_profile.name

The unique name of the profile.

_aws_profile.organization

Information about this profile's membership in the AWS organization.

Show child fields
_aws_profile.organization.account_name

The name of account speciifed by the organization

_aws_profile.organization.id

The organization id

_aws_profile.organization.master_account
Show child fields
_aws_profile.organization.master_account.email

The organization master account email address

_aws_profile.organization.master_account.id

The organization master account id

_aws_profile.organization.parents[]
Show child fields
_aws_profile.organization.parents[].id

The id of the parent

_aws_profile.organization.parents[].name

The name of the parent

_aws_profile.organization.parents[].tags[]
Show child fields
_aws_profile.organization.parents[].tags[].key
_aws_profile.organization.parents[].tags[].value
_aws_profile.organization.parents[].type

The type of parent can be an organization unit or a root

_aws_profile.organization.tags[]
Show child fields
_aws_profile.organization.tags[].key
_aws_profile.organization.tags[].value
_aws_profile.type

The type of profile, either 'credentials' or 'assumed_role'

_aws_profile.via_profile_name

This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.

inference_benchmark

The details for a specific benchmark.

STRUCT(
    "metrics" STRUCT(
        "cost_per_hour" DOUBLE,
        "cost_per_inference" DOUBLE,
        "max_invocations" BIGINT,
        "model_latency" BIGINT,
        "cpu_utilization" DOUBLE,
        "memory_utilization" DOUBLE,
        "model_setup_time" BIGINT
    ),
    "endpoint_metrics" STRUCT(
        "max_invocations" BIGINT,
        "model_latency" BIGINT
    ),
    "endpoint_configuration" STRUCT(
        "endpoint_name" VARCHAR,
        "variant_name" VARCHAR,
        "instance_type" VARCHAR,
        "initial_instance_count" BIGINT,
        "serverless_config" STRUCT(
            "memory_size_in_mb" BIGINT,
            "max_concurrency" BIGINT,
            "provisioned_concurrency" BIGINT
        )
    ),
    "model_configuration" STRUCT(
        "inference_specification_name" VARCHAR,
        "environment_parameters" STRUCT(
            "key" VARCHAR,
            "value_type" VARCHAR,
            "value" VARCHAR
        )[],
        "compilation_job_name" VARCHAR
    ),
    "failure_reason" VARCHAR,
    "invocation_end_time" TIMESTAMP_S,
    "invocation_start_time" TIMESTAMP_S
)
Show child fields
inference_benchmark.endpoint_configuration

The endpoint configuration made by Inference Recommender during a recommendation job.

Show child fields
inference_benchmark.endpoint_configuration.endpoint_name

The name of the endpoint made during a recommendation job.

inference_benchmark.endpoint_configuration.initial_instance_count

The number of instances recommended to launch initially.

inference_benchmark.endpoint_configuration.instance_type

The instance type recommended by Amazon SageMaker Inference Recommender.

inference_benchmark.endpoint_configuration.serverless_config

Specifies the serverless configuration for an endpoint variant.

Show child fields
inference_benchmark.endpoint_configuration.serverless_config.max_concurrency

The maximum number of concurrent invocations your serverless endpoint can process.

inference_benchmark.endpoint_configuration.serverless_config.memory_size_in_mb

The memory size of your serverless endpoint. Valid values are in 1 GB increments: 1024 MB, 2048 MB, 3072 MB, 4096 MB, 5120 MB, or 6144 MB.

inference_benchmark.endpoint_configuration.serverless_config.provisioned_concurrency

The amount of provisioned concurrency to allocate for the serverless endpoint. Should be less than or equal to MaxConcurrency.

This field is not supported for serverless endpoint recommendations for Inference Recommender jobs. For more information about creating an Inference Recommender job, see CreateInferenceRecommendationsJobs.

inference_benchmark.endpoint_configuration.variant_name

The name of the production variant (deployed model) made during a recommendation job.

inference_benchmark.endpoint_metrics

The metrics for an existing endpoint compared in an Inference Recommender job.

Show child fields
inference_benchmark.endpoint_metrics.max_invocations

The expected maximum number of requests per minute for the instance.

inference_benchmark.endpoint_metrics.model_latency

The expected model latency at maximum invocations per minute for the instance.

inference_benchmark.failure_reason

The reason why a benchmark failed.

inference_benchmark.invocation_end_time

A timestamp that shows when the benchmark completed.

inference_benchmark.invocation_start_time

A timestamp that shows when the benchmark started.

inference_benchmark.metrics

The metrics of recommendations.

Show child fields
inference_benchmark.metrics.cost_per_hour

Defines the cost per hour for the instance.

inference_benchmark.metrics.cost_per_inference

Defines the cost per inference for the instance .

inference_benchmark.metrics.cpu_utilization

The expected CPU utilization at maximum invocations per minute for the instance.

NaN indicates that the value is not available.

inference_benchmark.metrics.max_invocations

The expected maximum number of requests per minute for the instance.

inference_benchmark.metrics.memory_utilization

The expected memory utilization at maximum invocations per minute for the instance.

NaN indicates that the value is not available.

inference_benchmark.metrics.model_latency

The expected model latency at maximum invocation per minute for the instance.

inference_benchmark.metrics.model_setup_time

The time it takes to launch new compute resources for a serverless endpoint. The time can vary depending on the model size, how long it takes to download the model, and the start-up time of the container.

NaN indicates that the value is not available.

inference_benchmark.model_configuration

Defines the model configuration. Includes the specification name and environment parameters.

Show child fields
inference_benchmark.model_configuration.compilation_job_name

The name of the compilation job used to create the recommended model artifacts.

inference_benchmark.model_configuration.environment_parameters[]
Show child fields
inference_benchmark.model_configuration.environment_parameters[].key

The environment key suggested by the Amazon SageMaker Inference Recommender.

inference_benchmark.model_configuration.environment_parameters[].value

The value suggested by the Amazon SageMaker Inference Recommender.

inference_benchmark.model_configuration.environment_parameters[].value_type

The value type suggested by the Amazon SageMaker Inference Recommender.

inference_benchmark.model_configuration.inference_specification_name

The inference specification name in the model package version.