{"collection":{"slug":"data-engineering","name":"Data & Analytics Engineering"},"digest":{"id":"cwd_wWCgZQKM0wej127dhZcPb","weekStart":"2026-09-14","title":"dbt v2 goes GA and the analytics engine gets a Rust rewrite","intro":"dbt v2, a full Rust rewrite of the dbt engine, and dbt State both reached general availability alongside a Fivetran Context Layer, dbt Charts, and an open lakehouse vision, while the ClickHouse adapter arrived on the dbt platform in beta.","body":"### dbt v2 ships as a Rust engine\n\nThe week's dominant story is dbt Labs' [GA release of dbt v2 and dbt State](/release/rel_FDYEnuQ1kDTazPbmT58mh-fivetran-dbt-labs-makes-dbt-v2-and-dbt-state-ga-debuts-fivetran-context-layer), announced at dbt Summit 2026. dbt v2 is a full Rust rewrite that parses a 10,000-model project up to 10x faster than v1, distributed as the superset `dbt` and the Apache 2.0 subset `dbt-oss`. BigQuery, Databricks, DuckDB, Redshift, and Snowflake adapters are GA; ClickHouse and Spark remain in beta. Alongside it came Fivetran Context Layer in private beta with the open source Agents Schema standard, dbt Charts in public beta for version-controlled BI as YAML, and a set of Wizard experiences plus Lake Compute, a DuckDB-based single-node engine for Apache Iceberg tables. The [summit keynote framing](/release/rel_kFObsv1gF15VPtrs5bcgx-dbt-summit-2026-dbt-v2-ga-dbt-state-ga-lake-compute-and-anthropic-chatgpt) positions all of this as infrastructure for AI-driven analytics engineering — an engine fast enough to keep up with agents writing and rewriting models.\n\nThe practical payoff for teams is [dbt State going GA](/release/rel_MwmBuJdOFZnf_bE5g9qqy-dbt-state-now-ga-across-snowflake-bigquery-databricks-and-redshift) across Snowflake, BigQuery, Databricks, and Redshift. Instead of a schedule, it inspects model SQL and warehouse metadata each run to decide whether to build, skip, clone, or defer a node — no selection syntax, no manifest scripts — and works with your own orchestrator, including Airflow, Dagster, GitHub Actions, or a laptop. Pricing is consumption-based on daily active target tables, with reuse after the first in a day free.\n\n### ClickHouse deepens its dbt integration\n\nClickHouse's own [adapter for dbt v2 entered public beta](/release/rel_KuM4Br2k2xlxxznAs1sSp-clickhouse-is-now-available-on-the-dbt-platform), powered by the Rust engine, and ClickHouse joined the dbt platform in private beta for both open-source ClickHouse and ClickHouse Cloud. On the core side, [dbt-core v2.0.1](/release/rel_I9HGc3TvZ5loUehx_PgSA-dbt-core-v2-0-1-renames-cli-branding-to-dbt-proprietary-and-dbt-oss) renamed CLI branding from Fusion/dbt-core to `dbt` (proprietary) and `dbt-oss`, and the [2.0.0 release](/release/rel_TaC3PQnhOtMxAqJOHYYBQ-dbt-core-v2-0-0-adds-agent-skills-gating-databricks-metric-views-clickhouse) added agent skills installation gated behind a new `ai_provider` flag, native Databricks metric view materializations, and an `adbc_clickhouse` driver. The [2.0.5 patch](/release/rel_bYcnMU3ELUTn0nLrqNzEp-dbt-core-v2-0-5-fixes-bigquery-incremental-tables-using-replace-instead-of-merge) fixed BigQuery incremental tables that could be written with REPLACE TABLE instead of MERGE.\n\n### Observability and orchestration converge on ClickHouse\n\nClickHouse's other announcements all point the same direction: bring metrics, logs, and traces under one query engine. The new [TimeSeries Engine](/release/rel_HudS2E3RwgBxnUNXSSU0G-introducing-clickhouse-s-new-timeseries-engine-your-drop-in-prometheus) offers PromQL support as a drop-in Prometheus replacement, letting you query Prometheus metrics in ClickHouse Cloud without rewriting them in SQL. [Replica-aware routing reached public beta](/release/rel_G89Wm8geWiRZZviQJN6y--replica-aware-routing-public-beta), pinning requests to a single replica so temporary tables and named sessions stay visible over HTTP or the native protocol. The official [ClickHouse provider for Apache Airflow](/release/rel_33uYyBnUmd_Hw0G3XFchV-the-official-clickhouse-provider-for-apache-airflow-is-now-available) landed with standard SQL operators, bulk inserts, and shared setup across self-managed Airflow and Astronomer, while [ClickStack's August update](/release/rel_8NgxSSSSlM4QpCeGTZZAm-what-s-new-in-clickstack-aug-26) added dashboard variables, chart formulas, PromQL support, and LLM observability. Orchestration also moved at [Dagster](/release/rel_Hmv42Y25ZsPCwP6-XyZk_-1-13-23-core-0-29-23-libraries), which added deployment capacity alert policies in Dagster+.\n\nAgent ergonomics got attention too: Tinybird's MCP now lets you [choose MCP response formats and inspect query plans](/release/rel_lel1Wd23KNcgOmDikbueY-choose-mcp-response-formats-and-inspect-query-plans), accepting CSVWithNames, JSON, or Markdown and supporting `explain=true` before executing a query. Rounding out the week were routine ClickHouse stable and LTS builds and a handful of low-impact dbt-core patches, including [v1.12.5](/release/rel_3TW5_Y9_3kEUEctwLHuI8-dbt-core-v1-12-5-fixes-dimension-protocol-and-bumps-metricflow-floor) fixing the Dimension protocol and bumping the metricflow floor.","releaseIds":["rel_FDYEnuQ1kDTazPbmT58mh","rel_kFObsv1gF15VPtrs5bcgx","rel_MwmBuJdOFZnf_bE5g9qqy","rel_KuM4Br2k2xlxxznAs1sSp","rel_I9HGc3TvZ5loUehx_PgSA","rel_TaC3PQnhOtMxAqJOHYYBQ","rel_bYcnMU3ELUTn0nLrqNzEp","rel_HudS2E3RwgBxnUNXSSU0G","rel_G89Wm8geWiRZZviQJN6y-","rel_33uYyBnUmd_Hw0G3XFchV","rel_8NgxSSSSlM4QpCeGTZZAm","rel_Hmv42Y25ZsPCwP6-XyZk_","rel_lel1Wd23KNcgOmDikbueY","rel_3TW5_Y9_3kEUEctwLHuI8"],"releaseCount":33,"generatedAt":"2026-09-21T06:18:27.826Z","releases":[{"id":"rel_FDYEnuQ1kDTazPbmT58mh","title":"Fivetran + dbt Labs makes dbt v2 and dbt State GA, debuts Fivetran Context Layer and dbt Charts","path":"/release/rel_FDYEnuQ1kDTazPbmT58mh-dbt-v2-and-dbt-state-ga-fivetran-context-layer-dbt-charts-debut","org":{"slug":"dbt-labs","name":"dbt Labs"},"importance":5},{"id":"rel_kFObsv1gF15VPtrs5bcgx","title":"dbt Summit 2026: dbt v2 GA, dbt State GA, Lake Compute and Anthropic/ChatGPT integrations","path":"/release/rel_kFObsv1gF15VPtrs5bcgx-dbt-v2-ga-dbt-state-ga-lake-compute-beta","org":{"slug":"dbt-labs","name":"dbt Labs"},"importance":5},{"id":"rel_MwmBuJdOFZnf_bE5g9qqy","title":"dbt State now GA across Snowflake, BigQuery, Databricks, and Redshift","path":"/release/rel_MwmBuJdOFZnf_bE5g9qqy-dbt-state-ga-runs-on-change-not-schedule","org":{"slug":"dbt-labs","name":"dbt Labs"},"importance":4},{"id":"rel_KuM4Br2k2xlxxznAs1sSp","title":"ClickHouse is now available on the dbt platform","path":"/release/rel_KuM4Br2k2xlxxznAs1sSp-clickhouse-is-now-available-on-the-dbt-platform","org":{"slug":"clickhouse","name":"ClickHouse"},"importance":null},{"id":"rel_I9HGc3TvZ5loUehx_PgSA","title":"dbt-core v2.0.1 renames CLI branding to dbt (proprietary) and dbt-oss","path":"/release/rel_I9HGc3TvZ5loUehx_PgSA-cli-branding-renamed-to-dbt-proprietary-and-dbt-oss","org":{"slug":"dbt-labs","name":"dbt Labs"},"importance":3},{"id":"rel_TaC3PQnhOtMxAqJOHYYBQ","title":"dbt-core v2.0.0 adds agent skills gating, Databricks metric views, ClickHouse driver","path":"/release/rel_TaC3PQnhOtMxAqJOHYYBQ-agent-skills-gated-on-ai-provider-databricks-metric-views-supported","org":{"slug":"dbt-labs","name":"dbt Labs"},"importance":4},{"id":"rel_bYcnMU3ELUTn0nLrqNzEp","title":"dbt-core v2.0.5 fixes BigQuery incremental tables using REPLACE instead of MERGE","path":"/release/rel_bYcnMU3ELUTn0nLrqNzEp-bigquery-incremental-tables-no-longer-replace-instead-of-merge","org":{"slug":"dbt-labs","name":"dbt Labs"},"importance":2},{"id":"rel_HudS2E3RwgBxnUNXSSU0G","title":"Introducing ClickHouse's new TimeSeries Engine: Your drop-In Prometheus replacement","path":"/release/rel_HudS2E3RwgBxnUNXSSU0G-introducing-clickhouse-s-new-timeseries-engine-your-drop-in-prometheus","org":{"slug":"clickhouse","name":"ClickHouse"},"importance":null},{"id":"rel_G89Wm8geWiRZZviQJN6y-","title":"Replica-aware routing public beta","path":"/release/rel_G89Wm8geWiRZZviQJN6y--replica-aware-routing-public-beta","org":{"slug":"clickhouse","name":"ClickHouse"},"importance":null},{"id":"rel_33uYyBnUmd_Hw0G3XFchV","title":"The official ClickHouse provider for Apache Airflow is now available","path":"/release/rel_33uYyBnUmd_Hw0G3XFchV-the-official-clickhouse-provider-for-apache-airflow-is-now-available","org":{"slug":"clickhouse","name":"ClickHouse"},"importance":null},{"id":"rel_8NgxSSSSlM4QpCeGTZZAm","title":"What's new in ClickStack - Aug ’26","path":"/release/rel_8NgxSSSSlM4QpCeGTZZAm-what-s-new-in-clickstack-aug-26","org":{"slug":"clickhouse","name":"ClickHouse"},"importance":null},{"id":"rel_Hmv42Y25ZsPCwP6-XyZk_","title":"1.13.23 (core) / 0.29.23 (libraries)","path":"/release/rel_Hmv42Y25ZsPCwP6-XyZk_-1-13-23-core-0-29-23-libraries","org":{"slug":"dagster","name":"Dagster"},"importance":null},{"id":"rel_lel1Wd23KNcgOmDikbueY","title":"Choose MCP response formats and inspect query plans","path":"/release/rel_lel1Wd23KNcgOmDikbueY-choose-mcp-response-formats-and-inspect-query-plans","org":{"slug":"tinybird","name":"Tinybird"},"importance":null},{"id":"rel_3TW5_Y9_3kEUEctwLHuI8","title":"dbt-core v1.12.5 fixes Dimension protocol and bumps metricflow floor","path":"/release/rel_3TW5_Y9_3kEUEctwLHuI8-dimension-protocol-fixed-metricflow-floor-raised-to-0-213-0","org":{"slug":"dbt-labs","name":"dbt Labs"},"importance":1}]}}