Live data from Hacker News

Catching silent data loss using BigQuery's native ML and Write API

robertsahlin.substack.com

1–2 of 2 posts

Re: Catching silent data loss using BigQuery's native ML and Write API

#2
We needed a way to detect ingestion anomalies across 200+ microservices without building a separate ML stack. It turns out BigQuery already tracks every row written in WRITE_API_TIMELINE, and its built-in AI.DETECT_ANOMALIES (powered by Google’s TimesFM) can handle the detection.