How do I run and validate Athena pipelines from GitLab CI?
Call bruin validate and bruin run in a GitLab CI job against Athena. Connections come from CI secrets, and a failing check blocks the merge before bad data lands in Athena. Bruin does this in one platform: ingestion, SQL and Python pipelines, quality checks, lineage, and an AI data analyst that answers in Slack, Microsoft Teams, Google Chat, WhatsApp, Discord, Telegram, email and the browser.
Command
bruin runDefined in
YAML + CI
Works with
GitLab CI + Athena
What you get
How it works in code
# gitlab job
- run: bruin validate ./pipeline
- run: bruin run ./pipeline # athenaRun bruin run and the Athena pipeline runs on merge or on schedule from GitLab CI.
Related use cases
Run Snowflake pipelines in GitLab CI
How do I run and validate Snowflake pipelines from GitLab CI?
Run pipelines in GitLab CIRun BigQuery pipelines in GitLab CI
How do I run and validate BigQuery pipelines from GitLab CI?
Run pipelines in GitLab CIRun Postgres pipelines in GitLab CI
How do I run and validate Postgres pipelines from GitLab CI?
Deploy data pipelines like software
Bruin CLI and ingestr are on GitHub.
A demo walks through your own data.