How do I run incremental models on BigQuery without hand-writing merge logic?
Declare the materialization strategy in the asset's YAML. Bruin generates the incremental merge or delete+insert for BigQuery, so you describe intent instead of writing boilerplate.
Command
bruin runDefined in
SQL + YAML
Works with
BigQuery + Bruin CLI
What you get
Incremental materializationmerge strategiesno boilerplate
How it works in code
materialization:
type: table
strategy: merge
incremental_key: updated_atRun bruin run and Bruin manages the incremental load into BigQuery for you.
Related use cases
SQL and Python pipelines
Build a SQL + Python pipeline on Snowflake
How do I run SQL and Python transformations together on Snowflake?
SQL and Python pipelinesMaterialize a table incrementally on Snowflake
How do I run incremental models on Snowflake without hand-writing merge logic?
SQL and Python pipelinesBuild a SQL + Python pipeline on BigQuery
How do I run SQL and Python transformations together on BigQuery?
SQL and Python, one pipeline
Bruin CLI and ingestr are on GitHub.
A demo walks through your own data.