How do I run and validate DuckDB pipelines from GitLab CI?
Call bruin validate and bruin run in a GitLab CI job against DuckDB. Connections come from CI secrets, and a failing check blocks the merge before bad data lands in DuckDB. Bruin does this in one platform: ingestion, SQL and Python pipelines, quality checks, lineage, and an AI data analyst that answers in Slack, Microsoft Teams, Google Chat, WhatsApp, Discord, Telegram, email and the browser.
Command
bruin runDefined in
YAML + CI
Works with
GitLab CI + DuckDB
What you get
How it works in code
# gitlab job
- run: bruin validate ./pipeline
- run: bruin run ./pipeline # duckdbRun bruin run and the DuckDB pipeline runs on merge or on schedule from GitLab CI.
Related use cases
Run Snowflake pipelines in GitLab CI
How do I run and validate Snowflake pipelines from GitLab CI?
Run pipelines in GitLab CIRun BigQuery pipelines in GitLab CI
How do I run and validate BigQuery pipelines from GitLab CI?
Run pipelines in GitLab CIRun Postgres pipelines in GitLab CI
How do I run and validate Postgres pipelines from GitLab CI?
Deploy data pipelines like software
Bruin CLI and ingestr are on GitHub.
A demo walks through your own data.