Skip to content
AWS for Query.Farm

aws.lookoutequipment.list_sensor_statistics

Example SQL Queries

SELECT * FROM
aws.lookoutequipment.list_sensor_statistics
WHERE
"dataset_name" = 'VALUE';

Description

Lists statistics about the data collected for each of the sensors that have been successfully ingested in the particular dataset. Can also be used to retreive Sensor Statistics for a previous ingestion job.

Table Definition

Column NameColumn Data Type
dataset_name Required Input Column

The name of the dataset associated with the list of Sensor Statistics. 

VARCHAR
ingestion_job_id Input Column

The ingestion job id associated with the list of Sensor Statistics. To get sensor statistics for a particular ingestion job id, both dataset name and ingestion job id must be submitted as inputs. 

VARCHAR
max_results Input Column

Specifies the maximum number of sensors for which to retrieve statistics. 

BIGINT
next_token Input Column

An opaque pagination token indicating where to continue the listing of sensor statistics. 

VARCHAR
_aws_profile Input Column

The AWS profile defines the AWS identity used. It can be defined via credentials or by assuming a IAM role.

STRUCT(
    "type" VARCHAR,
    "name" VARCHAR,
    "account_id" VARCHAR,
    "via_profile_name" VARCHAR,
    "assumed_role_arn" VARCHAR,
    "organization" STRUCT(
        "account_name" VARCHAR,
        "id" VARCHAR,
        "tags" STRUCT(
            "key" VARCHAR,
            "value" VARCHAR
        )[],
        "master_account" STRUCT(
            "id" VARCHAR,
            "email" VARCHAR
        ),
        "parents" STRUCT(
            "type" VARCHAR,
            "id" VARCHAR,
            "name" VARCHAR,
            "tags" STRUCT(
                "key" VARCHAR,
                "value" VARCHAR
            )[]
        )[]
    )
)
Show child fields
_aws_profile.account_id

The AWS account id

_aws_profile.assumed_role_arn

The ARN of the assumed role

_aws_profile.name

The unique name of the profile.

_aws_profile.organization

Information about this profile's membership in the AWS organization.

Show child fields
_aws_profile.organization.account_name

The name of account speciifed by the organization

_aws_profile.organization.id

The organization id

_aws_profile.organization.master_account
Show child fields
_aws_profile.organization.master_account.email

The organization master account email address

_aws_profile.organization.master_account.id

The organization master account id

_aws_profile.organization.parents[]
Show child fields
_aws_profile.organization.parents[].id

The id of the parent

_aws_profile.organization.parents[].name

The name of the parent

_aws_profile.organization.parents[].tags[]
Show child fields
_aws_profile.organization.parents[].tags[].key
_aws_profile.organization.parents[].tags[].value
_aws_profile.organization.parents[].type

The type of parent can be an organization unit or a root

_aws_profile.organization.tags[]
Show child fields
_aws_profile.organization.tags[].key
_aws_profile.organization.tags[].value
_aws_profile.type

The type of profile, either 'credentials' or 'assumed_role'

_aws_profile.via_profile_name

This IAM role for this profile is assumed by first utilizing another profile with this name to obtain credentials.

_aws_region Input Column

The AWS region to use.

VARCHAR
sensor_statistics_summaries

Provides ingestion-based statistics regarding the specified sensor with respect to various validation types, such as whether data exists, the number and percentage of missing values, and the number and percentage of duplicate timestamps. 

STRUCT(
    "component_name" VARCHAR,
    "sensor_name" VARCHAR,
    "data_exists" BOOLEAN,
    "missing_values" STRUCT(
        "count" BIGINT,
        "percentage" DOUBLE
    ),
    "invalid_values" STRUCT(
        "count" BIGINT,
        "percentage" DOUBLE
    ),
    "invalid_date_entries" STRUCT(
        "count" BIGINT,
        "percentage" DOUBLE
    ),
    "duplicate_timestamps" STRUCT(
        "count" BIGINT,
        "percentage" DOUBLE
    ),
    "categorical_values" STRUCT(
        "status" VARCHAR,
        "number_of_category" BIGINT
    ),
    "multiple_operating_modes" STRUCT(
        "status" VARCHAR
    ),
    "large_timestamp_gaps" STRUCT(
        "status" VARCHAR,
        "number_of_large_timestamp_gaps" BIGINT,
        "max_timestamp_gap_in_days" BIGINT
    ),
    "monotonic_values" STRUCT(
        "status" VARCHAR,
        "monotonicity" VARCHAR
    ),
    "data_start_time" TIMESTAMP_S,
    "data_end_time" TIMESTAMP_S
)[]
Show child fields
sensor_statistics_summaries[]
Show child fields
sensor_statistics_summaries[].categorical_values

Parameter that describes potential risk about whether data associated with the sensor is categorical.

Show child fields
sensor_statistics_summaries[].categorical_values.number_of_category

Indicates the number of categories in the data.

sensor_statistics_summaries[].categorical_values.status

Indicates whether there is a potential data issue related to categorical values.

sensor_statistics_summaries[].component_name

Name of the component to which the particular sensor belongs for which the statistics belong to.

sensor_statistics_summaries[].data_end_time

Indicates the time reference to indicate the end of valid data associated with the sensor that the statistics belong to.

sensor_statistics_summaries[].data_exists

Parameter that indicates whether data exists for the sensor that the statistics belong to.

sensor_statistics_summaries[].data_start_time

Indicates the time reference to indicate the beginning of valid data associated with the sensor that the statistics belong to.

sensor_statistics_summaries[].duplicate_timestamps

Parameter that describes the total number of duplicate timestamp records associated with the sensor that the statistics belong to.

Show child fields
sensor_statistics_summaries[].duplicate_timestamps.count

Indicates the count of occurences of the given statistic.

sensor_statistics_summaries[].duplicate_timestamps.percentage

Indicates the percentage of occurances of the given statistic.

sensor_statistics_summaries[].invalid_date_entries

Parameter that describes the total number of invalid date entries associated with the sensor that the statistics belong to.

Show child fields
sensor_statistics_summaries[].invalid_date_entries.count

Indicates the count of occurences of the given statistic.

sensor_statistics_summaries[].invalid_date_entries.percentage

Indicates the percentage of occurances of the given statistic.

sensor_statistics_summaries[].invalid_values

Parameter that describes the total number of, and percentage of, values that are invalid for the sensor that the statistics belong to.

Show child fields
sensor_statistics_summaries[].invalid_values.count

Indicates the count of occurences of the given statistic.

sensor_statistics_summaries[].invalid_values.percentage

Indicates the percentage of occurances of the given statistic.

sensor_statistics_summaries[].large_timestamp_gaps

Parameter that describes potential risk about whether data associated with the sensor contains one or more large gaps between consecutive timestamps.

Show child fields
sensor_statistics_summaries[].large_timestamp_gaps.max_timestamp_gap_in_days

Indicates the size of the largest timestamp gap, in days.

sensor_statistics_summaries[].large_timestamp_gaps.number_of_large_timestamp_gaps

Indicates the number of large timestamp gaps, if there are any.

sensor_statistics_summaries[].large_timestamp_gaps.status

Indicates whether there is a potential data issue related to large gaps in timestamps.

sensor_statistics_summaries[].missing_values

Parameter that describes the total number of, and percentage of, values that are missing for the sensor that the statistics belong to.

Show child fields
sensor_statistics_summaries[].missing_values.count

Indicates the count of occurences of the given statistic.

sensor_statistics_summaries[].missing_values.percentage

Indicates the percentage of occurances of the given statistic.

sensor_statistics_summaries[].monotonic_values

Parameter that describes potential risk about whether data associated with the sensor is mostly monotonic.

Show child fields
sensor_statistics_summaries[].monotonic_values.monotonicity

Indicates the monotonicity of values. Can be INCREASING, DECREASING, or STATIC.

sensor_statistics_summaries[].monotonic_values.status

Indicates whether there is a potential data issue related to having monotonic values.

sensor_statistics_summaries[].multiple_operating_modes

Parameter that describes potential risk about whether data associated with the sensor has more than one operating mode.

Show child fields
sensor_statistics_summaries[].multiple_operating_modes.status

Indicates whether there is a potential data issue related to having multiple operating modes.

sensor_statistics_summaries[].sensor_name

Name of the sensor that the statistics belong to.