Google Cloud Storage integration

Google Cloud Storage data, in your warehouse.

A built-in ingestr connector: add credentials, pick tables, schedule it.

name: raw.table
type: ingestr
parameters:
  source_connection: google_cloud_storage
  source_table: '<table>'
  destination: snowflake
  incremental_strategy: merge

$ bruin run assets/raw/google_cloud_storage.asset.yml

  1. extract · Google Cloud Storage dataincremental
  2. load · snowflake raw.datamerged
  3. checks · not_null, unique

Loaded and checked. Downstream models can run.

How it connects

Connected in three steps.

Google's cloud object storage service providing scalable and secure data storage with global accessibility and integration with Google Cloud Platform.

  1. 01

    Add a Google Cloud Storage connection with its credentials.

  2. 02

    Pick the tables to load and how: replace, append or merge.

  3. 03

    Bruin runs it on your schedule and checks every load.

Connection parameters

credentials_path
Path to Google Cloud service account JSON file
project_id
Google Cloud Project ID

Every way Google Cloud Storage works with Bruin

  • SourceBuilt-in ingestr sourceDocs →
  • DestinationBuilt-in ingestr destinationDocs →
  • Query engineRuns SQL and Python assetsDocs →

The platform

Part of the Bruin platform.

Data in, ready for everything downstream: the models, the checks, the lineage and the AI layer.

Frequently asked

Questions about Google Cloud Storage.

Does Bruin have a built-in Google Cloud Storage integration?

Yes. Built-in ingestr source. Built-in ingestr destination. Runs SQL and Python assets.

Where can Google Cloud Storage data go?

Snowflake, BigQuery, Databricks, Redshift, ClickHouse, Postgres, DuckDB, MotherDuck, Microsoft Fabric and more, plus files on S3 and GCS.

How fresh is the data?

As fresh as your schedule. Incremental loads append, merge or replace a time window, every few minutes if you like.

Do we need Bruin Cloud?

No. The Bruin CLI and ingestr run locally, in CI or in your own orchestrator. Bruin Cloud adds scheduling, lineage, alerts and the AI data analyst on top.

Ready to connect Google Cloud Storage?

$100 in credits and 50 AI tasks. No credit card.

A demo walks through your own data.

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.

The signup form is hosted by Brevo. Allow marketing cookies to load it.