Reference

This page provides a guide to the BigQuery tables used for training models, including their schemas and field descriptions. You'll also find a breakdown of the core concepts—snapshots, assets, and observations—that structure the data, along with details on how to use the tables where relevant.

snapshots

A snapshot is a fixed, unchangeable copy of a dataset at a specific moment in time. The snapshot table provides metadata associated with snapshots, to allow you to understand the temporal state of the data at a high level.

Column name Type Description
snapshot_id STRING Unique identifier for the snapshot. Used as a key to join tables.
subscription_id STRING Unique identifier for the subscription.
creation_time TIMESTAMP ISO 8601 formatted timestamp e.g., 2019-09-25 17:26:27.757171 UTC.

all_observations

An "observation" is a sighting of an asset in the real world. Observations differ from assets in that they contain metadata for the detection of an asset, i.e., the time the image was captured and the position of the camera.

The all_observations table provides observations from all snapshots. You can use this table to detect differences in observations between snapshots.

Column name Type Description
snapshot_id STRING Unique identifier for the snapshot. Used as a key to join tables.
asset_id STRING Unique identifier for the asset.
asset_type STRING Major classification of the asset e.g., ASSET_CLASS_ROAD_SIGN.
location STRUCT Struct containing lat/lng coordinates as floats.
detection_time TIMESTAMP ISO 8601 formatted timestamp e.g., 2019-09-25 17:26:27.757171 UTC.
observation_id STRING String that uniquely identifies the observation.
bbox STRUCT Struct of structs containing the x/y coordinates aligning the asset's bounding box.
camera_pose STRUCT Struct containing floats for lat/lng, altitude (in meters), pitch, heading, and roll.
capture_time TIMESTAMP ISO 8601 formatted timestamp e.g., 2019-09-25 17:26:27.757171 UTC.
gcs_uri STRING Google Cloud Storage URI where the image is hosted.
map_url STRING Google Maps URL that shows the location of the observation.

all_assets

An "asset" is an object in the real world. The all_assets table provides assets from all snapshots. You can use this table to detect differences in assets between snapshots.

Column name Type Description
asset_id STRING Unique identifier for the asset.
snapshot_id STRING Unique identifier for the snapshot. Used as a key to join tables.
asset_type STRING Major classification of the asset e.g., ASSET_CLASS_ROAD_SIGN.
observation_id STRING String that uniquely identifies the observation.
location STRUCT Struct containing lat/lng coordinates as floats.
detection_time TIMESTAMP ISO 8601 formatted timestamp e.g., 2019-09-25 17:26:27.757171 UTC.

latest_observations

The latest_observations table provides observations only from the most recent snapshot.

Column name Type Description
snapshot_id STRING Unique identifier for the snapshot. Used as a key to join tables.
asset_id STRING Unique identifier for the asset.
asset_type STRING Major classification of the asset e.g., ASSET_CLASS_ROAD_SIGN.
location STRUCT Struct containing lat/lng coordinates as floats.
detection_time TIMESTAMP ISO 8601 formatted timestamp e.g., 2019-09-25 17:26:27.757171 UTC.
observation_id STRING String that uniquely identifies the observation.
bbox STRUCT Struct of structs containing the x/y coordinates aligning the asset's bounding box.
camera_pose STRUCT Struct containing floats for lat/lng, altitude (in meters), pitch, heading, and roll.
capture_time TIMESTAMP ISO 8601 formatted timestamp e.g., 2019-09-25 17:26:27.757171 UTC.
gcs_uri STRING Google Cloud Storage URI where the image is hosted.
map_url STRING Google Maps URL that shows the location of the observation.

latest_assets

The latest_assets table provides assets only from the most recent snapshot.

Column name Type Description
asset_id STRING Unique identifier for the asset.
snapshot_id STRING Unique identifier for the snapshot. Used as a key to join tables.
asset_type STRING Major classification of the asset e.g., ASSET_CLASS_ROAD_SIGN.
observation_id STRING String that uniquely identifies the observation.
location STRUCT Struct containing lat/lng coordinates as floats.
detection_time TIMESTAMP ISO 8601 formatted timestamp e.g., 2019-09-25 17:26:27.757171 UTC.