DuckDB integration
DuckDB data, in your warehouse.
A built-in ingestr connector: add credentials, pick tables, schedule it.
name: raw.main_analytics
type: ingestr
parameters:
source_connection: duckdb
source_table: 'main.analytics'
destination: snowflake
incremental_strategy: merge$ bruin run assets/raw/duckdb.asset.yml
- extract · DuckDB main.analyticsincremental
- load · snowflake raw.main_analyticsmerged
- checks · not_null, unique
Loaded and checked. Downstream models can run.
How it connects
Connected in three steps.
DuckDB is an in-process SQL OLAP database management system designed for analytical queries.
- 01
Add a DuckDB connection with its credentials.
- 02
Pick the tables to load and how: replace, append or merge.
- 03
Bruin runs it on your schedule and checks every load.
Connection parameters
- path
- Path to database file (use :memory: for in-memory)
- read_only
- Optional flag for read-only access
- threads
- Number of threads to use
Tables
3 tables, ready to load.
main.analyticsstaging.importsexports.reports
The platform
Part of the Bruin platform.
Data in, ready for everything downstream: the models, the checks, the lineage and the AI layer.
Sources
DatabasesWarehousesApps & APIsFiles & storageStreams & webhooksWeb scrapingMove
Data IngestionFrequently asked
Questions about DuckDB.
Does Bruin have a built-in DuckDB integration?
Yes. Built-in ingestr source. Built-in ingestr destination. Runs SQL and Python assets.
Which DuckDB tables can Bruin load?
main.analytics, staging.imports, exports.reports.
Where can DuckDB data go?
Snowflake, BigQuery, Databricks, Redshift, ClickHouse, Postgres, DuckDB, MotherDuck, Microsoft Fabric and more, plus files on S3 and GCS.
How fresh is the data?
As fresh as your schedule. Incremental loads append, merge or replace a time window, every few minutes if you like.
Do we need Bruin Cloud?
No. The Bruin CLI and ingestr run locally, in CI or in your own orchestrator. Bruin Cloud adds scheduling, lineage, alerts and the AI data analyst on top.
Ready to connect DuckDB?
$100 in credits and 50 AI tasks. No credit card.
A demo walks through your own data.