Nest Engineering Docs
Watcher

Inputs and outputs

Data contracts for Watcher

Inputs

  • Spanner: Pipelines and Organizations tables.
  • Settings: GRACE_PERIOD_MINUTES and delay mapping logic.

Outputs

  • Logs: warnings when pipelines are past the expected delay window.
  • Sentry: error events for stalled pipelines or failures.

Contracts

  • Pipeline delay mapping must stay consistent with Stream scheduling logic.

Last updated on

Architecture

Pipeline design and dependencies for Watcher

Schedule and triggers

Scheduling, triggers, and concurrency for Watcher