How do I make sure a source table is fresh before building on it?
Add a freshness check on the source. If the latest data is older than the threshold, the run fails instead of building stale downstream models. Bruin does this in one platform: ingestion, SQL and Python pipelines, quality checks, lineage, and an AI data analyst that answers in Slack, Microsoft Teams, Google Chat, WhatsApp, Discord, Telegram, email and the browser.
Command
bruin runDefined in
YAML + SQL
Works with
Bruin CLI + your warehouse
What you get
Custom SQL checksblocking gatesCI-friendly
How it works in code
custom_checks:
- name: no_future_dates
query: SELECT count(*) FROM orders WHERE created_at > now()Run bruin run and the run fails the moment the rule is violated.
Related use cases
Custom checks and gates
Write a custom SQL quality check
How do I write a custom check with my own SQL?
Custom checks and gatesBlock a pipeline when data quality fails
How do I stop bad data from reaching production tables?
Custom checks and gatesWarn without failing on a soft check
Can I get a warning without failing the whole run?
Catch bad data before it ships
Bruin CLI and ingestr are on GitHub.
A demo walks through your own data.