Nest Engineering Docs
Datalake

Interfaces

Inbound and outbound contracts for Datalake

Authentication

  • Internal service only. No external ingress.
  • Pub/Sub subscription access is controlled by IAM.

Base path

  • v1: /api/v1

Endpoint catalog

ResourceOperationsNotes
/healthGETHealth check and processor metrics

Inbound stream

  • Primary ingress is the Pub/Sub subscription configured by SOURCE_SUBSCRIPTION_NAME.
  • Messages must conform to the Spanner Change Stream payload schema.

Outbound dependencies

  • BigQuery dataset tables ({tableName}_changelog).
  • Pub/Sub topics created per table for downstream consumers.

Last updated on