Datadog integration

Datadog data, in your warehouse.

A Python asset calls the Datadog API. Bruin handles materialization and incremental loads.

Try for free
"""@bruin
name: raw.datadog
connection: snowflake
materialization:
  type: table
  strategy: merge
columns:
  - name: id
    primary_key: true
secrets:
  - key: datadog
    inject_as: API_KEY
@bruin"""

import os, requests

BASE_URL = "https://…"  # Datadog's API

def materialize():
    key = os.environ["API_KEY"]
    resp = requests.get(f"{BASE_URL}/records",
                        headers={"Authorization": key})
    return resp.json()  # Bruin loads and merges the rows

$ bruin run assets/raw/datadog.py

  1. materialize · Datadog API
  2. load · snowflake raw.datadogmerged on id
  3. not_null · id

Loaded and checked.

How it connects

Connected in three steps.

Cloud monitoring and security platform with infrastructure monitoring, APM, log management, and real-time dashboards.

  1. 01

    Store the Datadog API key as a Bruin secret.

  2. 02

    A Python asset calls the API and returns rows.

  3. 03

    Bruin handles materialization and the incremental strategy, then runs your checks.

The platform

Part of the Bruin platform.

Data in, ready for everything downstream: the models, the checks, the lineage and the AI layer.

Frequently asked

Questions about Datadog.

Does Bruin connect to Datadog?

Yes, through the Datadog API: a Python asset calls it and returns rows, and Bruin handles materialization, the incremental strategy and the checks. Or share test credentials and we build a dedicated connector within 7 days, or build it yourself and contribute it to ingestr.

How fresh is the data?

As fresh as your schedule. Incremental loads append, merge or replace a time window, every few minutes if you like.

Do we need Bruin Cloud?

No. The Bruin CLI and ingestr run locally, in CI or in your own orchestrator. Bruin Cloud adds scheduling, lineage, alerts and the AI data analyst on top.

Ready to connect Datadog?

$100 in credits and 50 AI tasks. No credit card.

A demo walks through your own data.

Sign up to our newsletter

Practical updates on open-source data pipelines, AI analysts, governance, and what we are shipping at Bruin.

The signup form is hosted by Brevo. Allow marketing cookies to load it.