Runbooks

API key failures (401/500)

Symptoms

• Clients receive 401 Unauthorized or {"detail": "API key is missing"}.
• Service returns 500 with "API key error" on every request.

Checks

1. Confirm the request includes X-API-Key.
2. Verify the INTERFACE_API_KEY secret exists in Secret Manager.
3. Ensure the service account has secretmanager.versions.access.
4. Restart the service to reload secrets.

Spanner connectivity errors

Symptoms

• Startup failure while warming the Spanner pool.
• Requests fail with Spanner connectivity errors.

Checks

1. Validate SPANNER_INSTANCE_ID and SPANNER_DATABASE_ID.
2. Confirm the service account has Spanner access.
3. Check network egress and VPC connector configuration (if used).

Slow queries or timeouts

Symptoms

• High p95 latency for search endpoints.
• Timeouts on large search requests.

Checks

1. Identify the endpoint and filters used by Bubble.
2. Review the query shape and index usage in the endpoint code.
3. Add or adjust Spanner indexes if necessary.
4. Reduce result size with tighter filters or lower limit.

CORS errors in Bubble

Symptoms

• Browser console shows CORS blocked requests.

Checks

1. Confirm ALLOWED_ORIGINS includes the Bubble app origin.
2. Redeploy after changes.