New: AI & text-to-SQL on your own SupersetBook a demo
D23 logoD23
All posts
Apache Superset

Apache Superset and dbt: A Semantic Layer Integration Guide

Learn how to integrate dbt's semantic layer with Apache Superset for governed metric definitions, self-serve BI, and production analytics.

DTD23 Team
15 minutes read

Understanding the Semantic Layer and Why It Matters

A semantic layer sits between your raw data warehouse and the tools your team uses to explore it. Think of it as a translation layer—it transforms technical database schemas into business-friendly metrics, dimensions, and relationships that non-technical users can understand and query without breaking governance.

Without a semantic layer, every analyst and dashboard creator rebuilds the same logic. Revenue gets calculated three different ways. Customer acquisition cost (CAC) diverges across reports. Definitions drift. Data governance becomes a game of whack-a-mole.

When you wire dbt's semantic layer into Apache Superset, you're doing something more powerful: you're centralizing metric definitions in code, versioning them like any other asset, and surfacing them directly in Superset's UI. This means self-serve BI users get pre-built, governed metrics without touching SQL. Your analytics team spends less time answering "why don't these numbers match?" and more time answering actual business questions.

The semantic layer approach is particularly valuable for teams managing embedded analytics at scale, where consistency and governance are non-negotiable. It's also essential for companies building internal BI platforms or standardizing metrics across multiple product lines.

What Is dbt's Semantic Layer?

dbt (data build tool) has evolved from a transformation orchestration tool into a full semantic modeling platform. The dbt Semantic Layer—powered by MetricFlow, dbt Labs' metrics engine—lets you define metrics, dimensions, and relationships in YAML, then expose them via API and to downstream tools like Superset.

Core Components of the dbt Semantic Layer

Metrics are the business KPIs you care about. Unlike a SQL calculation buried in a dashboard, a metric in dbt is a first-class object with a definition, a data type, and explicit dependencies. A metric might be "monthly_recurring_revenue" or "customer_count." When you change the definition, it updates everywhere.

Dimensions are the ways you want to slice metrics. These include categorical dimensions (like "region" or "product_tier") and time dimensions (like "month" or "fiscal_quarter"). Dimensions are reusable across metrics, ensuring consistency.

Entities link dimensions to facts. If you have a "customer" entity and a "transaction" fact table, entities define how to join them and which grain of analysis makes sense.

The dbt Semantic Layer exposes all of this via REST API and integrates with partner tools. Exploring the dbt Cloud Semantic Layer in Preset walks through how this integration works in practice, including the setup and configuration required.

When you integrate the semantic layer with Superset, users don't see YAML files or API calls. They see a clean, governed set of metrics and dimensions in their Superset UI. They can build charts by selecting a metric, choosing dimensions to slice by, and filtering—all without writing SQL.

Why Integrate dbt Semantic Layer with Apache Superset?

Apache Superset is an open-source visualization and BI platform that's particularly strong for embedded analytics, self-serve exploration, and cost-effective deployments at scale. When you combine it with dbt's semantic layer, you get several compounding benefits:

Single Source of Truth for Metrics: Your metrics are defined once, in code, under version control. Whether accessed via Superset, a custom application, or a data app, they're always consistent. This eliminates the metric fragmentation that plagues most analytics organizations.

Reduced Time-to-Dashboard: Instead of analysts writing custom SQL for every new dashboard, they select pre-built metrics and dimensions. A dashboard that used to take three days now takes three hours. For teams managing self-serve BI, this is transformational.

Data Governance Without Friction: The semantic layer acts as a guardrail. Business users can't accidentally query the wrong table or join on the wrong key because the layer abstracts away those choices. Access control happens at the metric and dimension level, not at the table level.

Scalability Across Teams and Products: If you're embedding Superset dashboards into a product or managing analytics for a portfolio of companies (common in private equity and venture capital), the semantic layer ensures consistency at scale. Every product, every portfolio company, uses the same metric definitions.

Cost Efficiency: Superset is open-source and runs on modest infrastructure. The semantic layer adds governance without adding licensing cost. Compared to Looker, Tableau, or Power BI, the total cost of ownership—especially for embedded use cases—is dramatically lower.

Prerequisites and Architecture Overview

Before wiring up the integration, ensure you have the foundational pieces in place.

What You Need

  • A dbt project with dbt Cloud (the semantic layer requires dbt Cloud; local dbt Core doesn't expose the API)
  • Metrics and dimensions defined in your dbt YAML files
  • An Apache Superset instance (version 4.0 or later recommended for best compatibility)
  • API access credentials from dbt Cloud
  • A data warehouse that both dbt and Superset can access (Snowflake, BigQuery, Redshift, Postgres, etc.)

Architecture Overview

The flow looks like this:

  1. dbt Cloud holds your semantic models and metric definitions in YAML.
  2. dbt Semantic Layer API exposes those metrics and dimensions.
  3. Apache Superset queries the semantic layer API to discover available metrics and dimensions.
  4. Superset's UI renders these as selectable options when building charts.
  5. Queries flow from Superset through the semantic layer to your data warehouse.

This architecture means Superset doesn't need to parse dbt YAML files directly. Instead, it speaks to a well-documented API. This keeps concerns separated and makes the integration more resilient to changes in either tool.

Setting Up dbt Semantic Layer for Superset

Let's walk through the hands-on setup. If you're already running dbt Cloud with metrics defined, you can skip the initial steps.

Step 1: Define Metrics and Dimensions in dbt YAML

Your dbt project needs semantic models and metrics. Here's a simplified example:

semanticmodels:
  - name: orders
    node_relation:
      schema_name: analytics
      alias: stg_orders
    entities:
      - name: order_id
        type: primary
      - name: customer_id
        type: foreign
    measures:
      - name: order_total
        agg: sum
        expr: amount
      - name: order_count
        agg: count
    dimensions:
      - name: created_date
        type: time
        expr: created_at
      - name: status
        type: categorical
        expr: order_status
 
metrics:
  - name: total_revenue
    description: "Total order revenue"
    type: simple
    label: "Total Revenue"
    time_grains: [day, month, quarter, year]
    timestamp: created_date
    measures:
      - order_total
  - name: order_volume
    description: "Count of orders"
    type: simple
    label: "Order Volume"
    time_grains: [day, month, week]
    timestamp: created_date
    measures:
      - order_count

This YAML defines a semantic model (the orders table), its measures (aggregatable fields like order_total), dimensions (ways to slice data like status), and metrics (business KPIs like total_revenue). The official dbt Labs guide on best practices for integrating with dbt Semantic Layer provides comprehensive detail on structuring these definitions correctly.

Step 2: Enable dbt Cloud and Verify Metrics

Deploy your dbt project to dbt Cloud (if not already there). dbt Cloud is required because the semantic layer API runs there; local dbt Core doesn't expose it.

Once deployed, navigate to your dbt Cloud project and verify that metrics are discoverable:

  • Run dbt parse to ensure all YAML is valid.
  • Check the "Semantic Layer" section in dbt Cloud to see your metrics and dimensions listed.
  • Test the API endpoint directly using curl or Postman to confirm it's responding.

Step 3: Generate dbt Cloud API Credentials

Superset needs credentials to query the semantic layer API. In dbt Cloud:

  1. Go to Account Settings → API Tokens.
  2. Create a new service account token with read access to the semantic layer.
  3. Copy the token; you'll use it in Superset.

Step 4: Configure Superset to Connect to dbt Semantic Layer

This is where the integration happens. In Superset, you have a few options:

Option A: Native dbt Semantic Layer Connector (Recommended)

Superset 4.0+ includes native support for dbt Semantic Layer. To configure it:

  1. Log into Superset as an admin.
  2. Go to Data → Databases → + Database.
  3. Select dbt Semantic Layer from the list of database types.
  4. Fill in:
    • Display Name: "dbt Metrics" (or your preferred name)
    • dbt Cloud URL: https://cloud.getdbt.com (or your dbt Cloud instance)
    • dbt Cloud Tenant: Your dbt Cloud account ID
    • dbt Semantic Layer API URL: The API endpoint (usually https://semantic-layer.cloud.getdbt.com/api/graphql)
    • API Token: Paste the service account token from Step 3
    • Project ID: Your dbt Cloud project ID
  5. Test the connection and save.

Once connected, Superset will automatically discover all metrics and dimensions from your dbt project. They'll appear in the dataset explorer and be available for chart building.

Option B: Using a Proxy or Custom Connector

If you're self-hosting Superset or need more control, you can use a proxy layer. The simplest way to make Superset dbt work like it should describes this approach in detail, including how to set up an identity-aware proxy for secure access and metadata syncing.

Building Charts with dbt Metrics in Superset

Once the semantic layer is connected, the user experience in Superset changes dramatically.

Creating a Simple Metric Chart

  1. In Superset, click + Dashboard or open an existing dashboard.
  2. Click Edit Dashboard and then + Create Chart.
  3. For Datasource, select your dbt Semantic Layer database.
  4. For Chart Type, choose a visualization (e.g., "Number", "Bar Chart", "Time Series").
  5. In the Data tab:
    • Metrics: Select total_revenue or another metric.
    • Dimensions: Select created_date to break down by time, or status to break down by order status.
    • Filters: Add date ranges, status filters, etc.
  6. Preview and save.

Notice what didn't happen: no one wrote SQL. No one joined tables. The semantic layer handled all of that. If the revenue calculation changes in dbt, every chart using total_revenue automatically reflects the new definition.

Slicing Metrics Across Dimensions

The semantic layer's power becomes evident when you want to slice metrics across multiple dimensions:

  • Revenue by Region and Product Tier: Select total_revenue, then add both region and product_tier as grouping dimensions. The semantic layer knows how to join the necessary tables.
  • Customer Count Over Time by Cohort: Select customer_count, group by created_date (time grain: month), and add cohort as a secondary dimension.
  • Comparing Metrics: Many BI tools support metric-to-metric comparisons. In Superset with a semantic layer, you can compare total_revenue to order_count in a single chart, and both are automatically consistent.

Governance and Access Control

One of the hidden benefits of the semantic layer is that governance happens upstream. In dbt, you can:

  • Tag metrics as "public" or "sensitive" and use role-based access in Superset to expose only appropriate metrics to different user groups.
  • Document metrics in dbt with descriptions, owners, and SLAs. This metadata flows into Superset, so users see context.
  • Version metrics in Git. If a metric definition changes, you have a full audit trail.

When users build charts in Superset, they're constrained to the metrics and dimensions you've explicitly defined. They can't accidentally create incorrect calculations or query tables they shouldn't access.

Advanced Integration Patterns

Once the basic integration is working, you can layer on more sophisticated patterns.

Syncing dbt Metadata into Superset

Beyond metrics, you can sync other dbt metadata—descriptions, owners, tags, and lineage—into Superset. This enriches the data dictionary and helps users understand data quality and lineage.

Semantic Layer Sync with Apache Superset documents how to configure metadata sync, though this example uses Cube as the semantic layer. The pattern is similar with dbt: pull metadata from the semantic layer API and enrich Superset's dataset definitions.

In practice:

  1. Use a scheduled job (e.g., Airflow, dbt Cloud job) to query the dbt Semantic Layer API.
  2. Extract metric descriptions, owners, and tags.
  3. Update Superset's dataset metadata via Superset's API.
  4. Superset users now see rich context when building charts.

Text-to-SQL and AI-Assisted Queries

If you're using D23's AI-powered analytics or another text-to-SQL tool integrated with Superset, the semantic layer becomes even more valuable. Instead of an LLM generating arbitrary SQL, it can query the semantic layer API to understand available metrics and dimensions, then generate semantically correct queries.

For example, a user might ask: "Show me revenue by region for the last quarter." The LLM:

  1. Queries the semantic layer API to discover available metrics (total_revenue) and dimensions (region, created_date).
  2. Maps the user's natural language to semantic layer concepts.
  3. Generates a semantic layer query (not raw SQL).
  4. Returns the result.

This approach is more robust than free-form SQL generation because the LLM is constrained to valid metrics and dimensions.

Embedding Superset Dashboards with Semantic Layer Metrics

For product teams embedding Superset dashboards into applications, the semantic layer ensures consistency across all embedded instances. Whether a dashboard is viewed in Superset directly or embedded in a web app, it uses the same governed metrics.

The D23 embedded analytics platform is purpose-built for this use case. When you wire dbt's semantic layer into Superset and embed it via D23, you get:

  • Consistency: All embedded dashboards use the same metric definitions.
  • Governance: Access control and data governance happen at the semantic layer.
  • Performance: The semantic layer caches common queries, reducing load on your data warehouse.
  • Scalability: You can embed dashboards for thousands of users without managing separate BI instances.

Troubleshooting Common Integration Issues

Even with careful setup, integration issues arise. Here are the most common and how to resolve them.

Issue 1: Superset Can't Connect to dbt Semantic Layer API

Symptoms: "Connection refused" or "Unauthorized" errors when testing the database connection in Superset.

Causes:

  • Invalid API token (expired or insufficient permissions).
  • Network connectivity issues (firewall, VPN, IP allowlisting).
  • Incorrect API endpoint URL.

Resolution:

  1. Verify the API token is valid and has "Semantic Layer" read permissions in dbt Cloud.
  2. Test the API endpoint directly using curl: 
    curl -H "Authorization: Bearer YOUR_TOKEN" https://semantic-layer.cloud.getdbt.com/api/graphql
  3. Ensure your Superset instance can reach dbt Cloud (check firewall rules, VPN, etc.).
  4. Verify the dbt Cloud account ID and project ID are correct.

Issue 2: Metrics Appear in dbt but Not in Superset

Symptoms: You can see metrics in dbt Cloud's Semantic Layer UI, but they don't appear in Superset's dataset explorer.

Causes:

  • Metrics haven't been published yet (still in development branch).
  • Superset hasn't refreshed the metadata cache.
  • Metrics are tagged as internal or private in dbt.

Resolution:

  1. Ensure metrics are on the deployed branch in dbt Cloud (not a development branch).
  2. In Superset, go to Data → Datasets, find your dbt Semantic Layer database, and click "Refresh Metadata".
  3. Check dbt YAML for access or visibility tags that might restrict exposure.

Issue 3: Queries Are Slow or Timing Out

Symptoms: Charts load slowly or timeout when querying the semantic layer.

Causes:

  • Underlying data warehouse queries are inefficient.
  • Semantic layer API is overloaded.
  • Superset timeout settings are too aggressive.

Resolution:

  1. Use dbt's meta properties to add query hints (e.g., table size, cardinality) so the semantic layer optimizes queries.
  2. In dbt, ensure your semantic models are built on efficient staging tables, not raw source tables.
  3. In Superset, increase the query timeout under Settings → Advanced → SQL_QUERY_TIMEOUT.
  4. Consider caching frequently used metrics in Superset using its caching layer.

Issue 4: Access Control Isn't Working

Symptoms: Users see metrics they shouldn't have access to.

Causes:

  • Access control is defined in dbt but not enforced in Superset.
  • Superset's role-based access control (RBAC) isn't configured.

Resolution:

  1. In dbt, tag metrics with access levels (e.g., access: private, access: public).
  2. In Superset, configure roles and permissions under Settings → Manage Roles.
  3. Assign users to roles and restrict access to datasets and metrics accordingly.
  4. Test access by logging in as a restricted user and verifying they can't see restricted metrics.

Best Practices for dbt Semantic Layer + Superset

With the integration working, follow these practices to maximize value and minimize friction.

1. Organize Metrics by Business Domain

Group related metrics together in dbt using group tags:

metrics:
  - name: total_revenue
    group: financial_metrics
    ...
  - name: gross_margin
    group: financial_metrics
    ...
  - name: customer_acquisition_cost
    group: marketing_metrics
    ...

In Superset, this makes it easy for users to find metrics relevant to their domain.

2. Document Metrics Thoroughly

Include descriptions, calculation logic, and caveats in dbt:

metrics:
  - name: total_revenue
    description: >
      Total revenue from all orders. Excludes refunds and cancellations.
      Calculated as SUM(order_amount) where status != 'cancelled'.
      Updated daily at 2 AM UTC.
    meta:
      owner: "finance_team"
      sla: "updated_daily"
      calculation_logic: "SUM(orders.amount) WHERE orders.status != 'cancelled'"

When this metadata syncs to Superset, users have full context.

3. Use Time Grains Strategically

Define appropriate time grains for each metric:

metrics:
  - name: daily_active_users
    time_grains: [day, week, month]
    # Don't include year; it's not meaningful for daily users
  - name: annual_revenue
    time_grains: [month, quarter, year]
    # Don't include day; it's too granular

This guides users toward sensible aggregations and prevents misuse.

4. Version Metrics and Track Changes

Treat metric definitions like code. Use Git to track changes:

metrics:
  - name: total_revenue
    version: 2  # Incremented when definition changes
    description: "v2: Now excludes discounts (as of Q4 2024)"

Keep a changelog so users understand when metrics changed and why.

5. Leverage Superset's Caching

For frequently used metrics, enable caching in Superset:

  1. Go to Settings → Cache → Configure Caching.
  2. Set cache expiration for semantic layer queries (e.g., 1 hour for daily metrics, 15 minutes for real-time metrics).
  3. Users get faster dashboards; your data warehouse gets fewer repeated queries.

6. Monitor Query Performance

Use Superset's query performance tools to identify slow metrics:

  1. Go to Manage → Query History.
  2. Sort by execution time and identify metrics that consistently slow.
  3. Optimize the underlying dbt model or add indexes to your data warehouse.

7. Implement Role-Based Access Control

Not all metrics are for all users. In Superset:

  1. Create roles (e.g., "Finance", "Marketing", "Executive").
  2. Assign datasets and metrics to roles.
  3. Assign users to roles.
  4. Superset enforces access at query time.

Comparing dbt Semantic Layer Integration to Alternatives

You might wonder how dbt's semantic layer compares to other approaches.

vs. Manual SQL in Superset

Without a semantic layer, analysts write SQL directly in Superset. This is flexible but problematic:

  • No single source of truth: The same metric gets calculated differently in different dashboards.
  • No governance: Anyone can query any table.
  • Slow iteration: Every new dashboard requires SQL expertise.
  • Maintenance burden: When a table structure changes, queries break.

The semantic layer solves all of these.

vs. Preset's Managed Superset

Preset (owned by Airbnb) offers managed Superset hosting with dbt integration. Exploring the dbt Cloud Semantic Layer in Preset details their approach.

Preset is a good choice if you want a fully managed SaaS experience. However, if you prefer self-hosting or need more control over infrastructure, integrating dbt Semantic Layer directly into your own Superset instance (as described in this guide) gives you the same semantic layer benefits at lower cost.

vs. Looker, Tableau, Power BI

These commercial BI tools have semantic layers (LookML, Tableau's data model, Power BI's data model). They're mature but proprietary and expensive.

dbt + Superset offers:

  • Open source: No licensing costs; full control over code.
  • Flexibility: Integrate with any tool via API.
  • Version control: Metrics are code; they live in Git.
  • Lower TCO: Especially for embedded analytics or large-scale deployments.

The tradeoff is that you manage more infrastructure yourself. D23 handles that complexity for you if you want managed Superset with semantic layer integration.

Real-World Example: Portfolio Analytics for Private Equity

Let's walk through a concrete example: a private equity firm managing a portfolio of 15 companies. Each company has different data systems, but the PE firm needs standardized KPI reporting.

The Setup

  1. Centralized dbt Project: The PE firm maintains a single dbt project with semantic models for all portfolio companies. Each company's data is in a separate schema.

  2. Unified Metric Definitions: Metrics like "revenue," "EBITDA," and "customer_churn" are defined once in dbt, with variants for each company (e.g., total_revenue and total_revenue_company_a).

  3. Superset Instance: A single Superset instance is deployed on the PE firm's cloud account. It connects to the dbt Semantic Layer.

  4. Embedded Dashboards: Each portfolio company gets an embedded Superset dashboard showing their KPIs. The PE firm's leadership gets a consolidated view across all companies.

Benefits

  • Consistency: Revenue means the same thing for every company.
  • Scalability: Adding a new portfolio company means adding a new schema and a few new metrics in dbt—no new BI infrastructure.
  • Cost: Open-source Superset + dbt is far cheaper than licensing Looker or Tableau for 15 companies.
  • Speed: New KPI reports go from "weeks of custom development" to "days of metric definition and dashboard building."

Conclusion

Integrating dbt's semantic layer with Apache Superset creates a modern, governed analytics stack that scales. Metrics are defined once, versioned like code, and automatically available to every user and tool that needs them. Self-serve BI becomes truly self-serve because users work with pre-built, consistent metrics instead of writing SQL.

For data and engineering leaders building analytics platforms, embedded BI, or standardized reporting across teams, this integration is foundational. It's the difference between chaos (every dashboard calculating revenue differently) and coherence (one definition, everywhere).

Start small: define a few core metrics in dbt, wire them into Superset, and let a team of power users build dashboards. As they see the value—faster iteration, fewer questions about metric definitions, cleaner governance—expand to more metrics and more users.

The official dbt Labs guide on best practices for integrating with dbt Semantic Layer and Announcing dbt Metrics in the Semantic Layer provide additional depth on the semantic layer itself. For Superset-specific configuration, the Apache Superset documentation on connecting databases is your reference.

If you're running Superset at scale—especially for embedded use cases—D23 provides managed Superset hosting with built-in dbt semantic layer support, data consulting, and AI-powered analytics. Whether you self-host or go managed, the semantic layer pattern is the same: centralized metric definitions, governed access, and dashboards that actually agree with each other.