How do I run and validate Databricks pipelines from GitHub Actions?
Call bruin validate and bruin run in a GitHub Actions job against Databricks. Connections come from CI secrets, and a failing check blocks the merge before bad data lands in Databricks. Bruin does this in one platform: ingestion, SQL and Python pipelines, quality checks, lineage, and an AI data analyst that answers in Slack, Microsoft Teams, Google Chat, WhatsApp, Discord, Telegram, email and the browser.
Command
bruin runDefined in
YAML + CI
Works with
GitHub Actions + Databricks
What you get
How it works in code
# github job
- run: bruin validate ./pipeline
- run: bruin run ./pipeline # databricksRun bruin run and the Databricks pipeline runs on merge or on schedule from GitHub Actions.
Related use cases
Run Snowflake pipelines in GitHub Actions
How do I run and validate Snowflake pipelines from GitHub Actions?
Run pipelines in GitHub ActionsRun BigQuery pipelines in GitHub Actions
How do I run and validate BigQuery pipelines from GitHub Actions?
Run pipelines in GitHub ActionsRun Postgres pipelines in GitHub Actions
How do I run and validate Postgres pipelines from GitHub Actions?
Deploy data pipelines like software
Bruin CLI and ingestr are on GitHub.
A demo walks through your own data.