{"collection":{"slug":"data-engineering","name":"Data & Analytics Engineering"},"digest":{"id":"cwd_r6p3sMPh9SnJ9tNGnSaNY","weekStart":"2026-10-05","title":"Redshift data sharing lands in dbt as state-aware orchestration goes GA","intro":"dbt Labs shipped two of the week's biggest changes for warehouse teams: native Amazon Redshift data sharing read and write support, and the general availability of dbt State with node-level reuse. Meanwhile ClickHouse Cloud rolled its executable UDFs to GA and added JWT authentication.","body":"### dbt gets smarter about what it rebuilds — and where it writes\n\nThe headline for dbt users is **Redshift data sharing**. [dbt now supports Amazon Redshift data sharing](/release/rel_5TQWFjD-XIurnsH9pRHbo-dbt-adds-amazon-redshift-data-sharing-support-with-datasharing-true) via a new `datasharing: true` profile credential, which switches the dbt-redshift adapter's metadata queries over to Redshift-native `SVV_*` system views and `SHOW` APIs. The practical upshot: cross-database writes succeed, and dbt Mesh cross-project refs, Advanced CI, and workload isolation become usable for Redshift data sharing setups — no copying data between warehouses required. The migration away from legacy Postgres `pg_*` catalog views also speeds up metadata resolution under high concurrency. It's worth checking your release track before adopting: the flag is in Beta on the Latest track and not yet available on Compatible or Extended.\n\nRunning alongside it is the **general availability of dbt State**, which [reuses, clones, or rebuilds models at the node level](/release/rel_3AolQFnFdzXDRiyOvu9B--dbt-state-reaches-ga-with-model-reuse-and-0-094-per-daily-active-target-table) by comparing each node's compiled SQL and upstream freshness rather than rebuilding the whole project. Pricing lands at $0.094 per daily active target table, with each test counted separately. There are sharp edges to know about: views built on `select *`, non-deterministic Jinja, and BigQuery external sources lacking `loaded_at_field` or `loaded_at_query` are always rebuilt. If you were on the former state-aware orchestration, you'll need to map `build_after` to `lag_tolerance` and `require_fresh_data_from`, which default to 45m and `any` respectively when `build_after` is absent.\n\n### ClickHouse Cloud moves UDFs and auth forward\n\nOn the Cloud side, the most consequential change is that [executable UDFs are now generally available](/release/rel_8Db6ng6E12Sej3bWvl5FY-executable-udfs-are-now-generally-available-on-clickhouse-cloud) across AWS, GCP, and Azure, with native runtimes, network access, observability, and both API and Terraform support — a real step up from the earlier preview restrictions. Security teams get an easier path off static database credentials with [JWT authentication in ClickHouse Cloud](/release/rel_3-aJ42BVAxlHiQ0kyRXqU-introducing-jwt-authentication-in-clickhouse-cloud), letting clients connect using short-lived tokens issued by an identity provider. The vendor also kept up its cost-and-latency argument against rival warehouses, publishing comparisons showing ClickHouse Cloud at [438× better performance per dollar than BigQuery](/release/rel_3wsb-kIaJtE1o8YdjqunU-why-bigquery-can-t-match-clickhouse-cloud-for-real-time-analytics) and [752× versus Databricks](/release/rel_UeQaf7nBbU4kgnSv5lvbj-why-databricks-can-t-match-clickhouse-cloud-for-real-time-analytics) in CostBench.\n\n### Maintenance cadence and smaller fixes\n\nClickHouse's version streams continued their steady weekly churn, with stable and LTS branches across the 26.3, 26.7, 26.8, and 26.9 lines all picking up patches — routine maintenance rather than headline features, but worth a look if you pin to an LTS. Dagster shipped [a breaking change and richer run-limit errors](/release/rel_uF9siCCeWA9jepg8kb4Fi-1-13-26-core-0-29-26-libraries): `dagster-dbt` no longer installs `dbt-core`, which now lives behind the `dagster-dbt[dbt-core]` extra, so don't install `dbt-core` into an environment that also has dbt Fusion's `dbt` package — both claim the `dbt` import namespace and silently overwrite each other. Sensor ticks that ask for oversized runs now fail with an explicit error naming the offending requests. Tinybird, for its part, made [bulk member removal and faster Members pages](/release/rel_bUpgxqTp3T04nlrvgktl3-remove-several-organization-members-at-once) available to organization admins, with a confirmation dialog listing exactly who's about to go.","releaseIds":["rel_5TQWFjD-XIurnsH9pRHbo","rel_3AolQFnFdzXDRiyOvu9B-","rel_8Db6ng6E12Sej3bWvl5FY","rel_3-aJ42BVAxlHiQ0kyRXqU","rel_3wsb-kIaJtE1o8YdjqunU","rel_UeQaf7nBbU4kgnSv5lvbj","rel_uF9siCCeWA9jepg8kb4Fi","rel_bUpgxqTp3T04nlrvgktl3"],"releaseCount":34,"generatedAt":"2026-10-12T06:25:35.488Z","releases":[{"id":"rel_5TQWFjD-XIurnsH9pRHbo","title":"dbt adds Amazon Redshift data sharing support with datasharing: true","path":"/release/rel_5TQWFjD-XIurnsH9pRHbo-redshift-data-sharing-support-cross-database-writes-enabled","url":"https://www.getdbt.com/blog/dbt-now-supports-amazon-redshift-data-sharing","org":{"slug":"dbt-labs","name":"dbt Labs","avatarUrl":"https://media.releases.sh/orgs/dbt-labs.png","githubHandle":"dbt-labs"},"product":null,"importance":4,"composition":null,"publishedAt":"2026-10-09T22:02:00.000Z"},{"id":"rel_3AolQFnFdzXDRiyOvu9B-","title":"dbt State reaches GA with model reuse and $0.094 per daily active target table pricing","path":"/release/rel_3AolQFnFdzXDRiyOvu9B--dbt-state-ga-models-reuse-instead-of-rebuilding","url":"https://www.getdbt.com/blog/dbt-state-stop-rebuilding","org":{"slug":"dbt-labs","name":"dbt Labs","avatarUrl":"https://media.releases.sh/orgs/dbt-labs.png","githubHandle":"dbt-labs"},"product":null,"importance":4,"composition":{"bugs":0,"features":1,"enhancements":0},"publishedAt":"2026-10-05T19:33:00.000Z"},{"id":"rel_8Db6ng6E12Sej3bWvl5FY","title":"Executable UDFs are now generally available on ClickHouse Cloud","path":"/release/rel_8Db6ng6E12Sej3bWvl5FY-executable-udfs-are-now-generally-available-on-clickhouse-cloud","url":"https://clickhouse.com/blog/executable-udfs-generally-available-on-clickhouse-cloud","org":{"slug":"clickhouse","name":"ClickHouse","avatarUrl":"https://media.releases.sh/orgs/clickhouse.png","githubHandle":"ClickHouse"},"product":null,"importance":null,"composition":null,"publishedAt":"2026-10-05T14:46:00.000Z"},{"id":"rel_3-aJ42BVAxlHiQ0kyRXqU","title":"Introducing JWT authentication in ClickHouse Cloud","path":"/release/rel_3-aJ42BVAxlHiQ0kyRXqU-introducing-jwt-authentication-in-clickhouse-cloud","url":"https://clickhouse.com/blog/introducing-jwt-authentication-in-clickhouse-cloud","org":{"slug":"clickhouse","name":"ClickHouse","avatarUrl":"https://media.releases.sh/orgs/clickhouse.png","githubHandle":"ClickHouse"},"product":null,"importance":null,"composition":null,"publishedAt":"2026-10-08T13:55:14.000Z"},{"id":"rel_3wsb-kIaJtE1o8YdjqunU","title":"Why BigQuery can’t match ClickHouse Cloud for real-time analytics","path":"/release/rel_3wsb-kIaJtE1o8YdjqunU-why-bigquery-can-t-match-clickhouse-cloud-for-real-time-analytics","url":"https://clickhouse.com/blog/clickhouse-vs-bigquery-real-time-performance-per-dollar","org":{"slug":"clickhouse","name":"ClickHouse","avatarUrl":"https://media.releases.sh/orgs/clickhouse.png","githubHandle":"ClickHouse"},"product":null,"importance":null,"composition":null,"publishedAt":"2026-10-08T10:49:15.000Z"},{"id":"rel_UeQaf7nBbU4kgnSv5lvbj","title":"Why Databricks can’t match ClickHouse Cloud for real-time analytics","path":"/release/rel_UeQaf7nBbU4kgnSv5lvbj-why-databricks-can-t-match-clickhouse-cloud-for-real-time-analytics","url":"https://clickhouse.com/blog/clickhouse-vs-databricks-real-time-performance-per-dollar","org":{"slug":"clickhouse","name":"ClickHouse","avatarUrl":"https://media.releases.sh/orgs/clickhouse.png","githubHandle":"ClickHouse"},"product":null,"importance":null,"composition":null,"publishedAt":"2026-10-06T12:26:14.000Z"},{"id":"rel_uF9siCCeWA9jepg8kb4Fi","title":"1.13.26 (core) / 0.29.26 (libraries)","path":"/release/rel_uF9siCCeWA9jepg8kb4Fi-1-13-26-core-0-29-26-libraries","url":"https://github.com/dagster-io/dagster/releases/tag/1.13.26","org":{"slug":"dagster","name":"Dagster","avatarUrl":"https://media.releases.sh/orgs/dagster.jpg","githubHandle":"dagster-io"},"product":null,"importance":null,"composition":null,"publishedAt":"2026-10-09T23:08:50.000Z"},{"id":"rel_bUpgxqTp3T04nlrvgktl3","title":"Remove several organization members at once","path":"/release/rel_bUpgxqTp3T04nlrvgktl3-remove-several-organization-members-at-once","url":"https://www.tinybird.co/docs/changelog/2026-10-09-october-week-two","org":{"slug":"tinybird","name":"Tinybird","avatarUrl":"https://media.releases.sh/orgs/tinybird.png","githubHandle":"tinybirdco"},"product":null,"importance":null,"composition":null,"publishedAt":"2026-10-09T00:00:00.000Z"}],"sections":[{"heading":"dbt gets smarter about what it rebuilds — and where it writes","anchor":"dbt-gets-smarter-about-what-it-rebuilds-and-where-it-writes","lede":"The headline for dbt users is Redshift data sharing. dbt now supports Amazon Redshift data sharing via a new datasharing: true profile credential, which switches the dbt-redshift adapter's metadata queries over to Redshift-native SVV_* system views and SHOW APIs.","releaseIds":["rel_5TQWFjD-XIurnsH9pRHbo","rel_3AolQFnFdzXDRiyOvu9B-"],"releases":[{"id":"rel_5TQWFjD-XIurnsH9pRHbo","title":"dbt adds Amazon Redshift data sharing support with datasharing: true","path":"/release/rel_5TQWFjD-XIurnsH9pRHbo-redshift-data-sharing-support-cross-database-writes-enabled","url":"https://www.getdbt.com/blog/dbt-now-supports-amazon-redshift-data-sharing","org":{"slug":"dbt-labs","name":"dbt Labs","avatarUrl":"https://media.releases.sh/orgs/dbt-labs.png","githubHandle":"dbt-labs"},"product":null,"importance":4,"composition":null,"publishedAt":"2026-10-09T22:02:00.000Z"},{"id":"rel_3AolQFnFdzXDRiyOvu9B-","title":"dbt State reaches GA with model reuse and $0.094 per daily active target table pricing","path":"/release/rel_3AolQFnFdzXDRiyOvu9B--dbt-state-ga-models-reuse-instead-of-rebuilding","url":"https://www.getdbt.com/blog/dbt-state-stop-rebuilding","org":{"slug":"dbt-labs","name":"dbt Labs","avatarUrl":"https://media.releases.sh/orgs/dbt-labs.png","githubHandle":"dbt-labs"},"product":null,"importance":4,"composition":{"bugs":0,"features":1,"enhancements":0},"publishedAt":"2026-10-05T19:33:00.000Z"}]},{"heading":"ClickHouse Cloud moves UDFs and auth forward","anchor":"clickhouse-cloud-moves-udfs-and-auth-forward","lede":"On the Cloud side, the most consequential change is that executable UDFs are now generally available across AWS, GCP, and Azure, with native runtimes, network access, observability, and both API and Terraform support — a real step up from the earlier preview restrictions.","releaseIds":["rel_8Db6ng6E12Sej3bWvl5FY","rel_3-aJ42BVAxlHiQ0kyRXqU","rel_3wsb-kIaJtE1o8YdjqunU","rel_UeQaf7nBbU4kgnSv5lvbj"],"releases":[{"id":"rel_8Db6ng6E12Sej3bWvl5FY","title":"Executable UDFs are now generally available on ClickHouse Cloud","path":"/release/rel_8Db6ng6E12Sej3bWvl5FY-executable-udfs-are-now-generally-available-on-clickhouse-cloud","url":"https://clickhouse.com/blog/executable-udfs-generally-available-on-clickhouse-cloud","org":{"slug":"clickhouse","name":"ClickHouse","avatarUrl":"https://media.releases.sh/orgs/clickhouse.png","githubHandle":"ClickHouse"},"product":null,"importance":null,"composition":null,"publishedAt":"2026-10-05T14:46:00.000Z"},{"id":"rel_3-aJ42BVAxlHiQ0kyRXqU","title":"Introducing JWT authentication in ClickHouse Cloud","path":"/release/rel_3-aJ42BVAxlHiQ0kyRXqU-introducing-jwt-authentication-in-clickhouse-cloud","url":"https://clickhouse.com/blog/introducing-jwt-authentication-in-clickhouse-cloud","org":{"slug":"clickhouse","name":"ClickHouse","avatarUrl":"https://media.releases.sh/orgs/clickhouse.png","githubHandle":"ClickHouse"},"product":null,"importance":null,"composition":null,"publishedAt":"2026-10-08T13:55:14.000Z"},{"id":"rel_3wsb-kIaJtE1o8YdjqunU","title":"Why BigQuery can’t match ClickHouse Cloud for real-time analytics","path":"/release/rel_3wsb-kIaJtE1o8YdjqunU-why-bigquery-can-t-match-clickhouse-cloud-for-real-time-analytics","url":"https://clickhouse.com/blog/clickhouse-vs-bigquery-real-time-performance-per-dollar","org":{"slug":"clickhouse","name":"ClickHouse","avatarUrl":"https://media.releases.sh/orgs/clickhouse.png","githubHandle":"ClickHouse"},"product":null,"importance":null,"composition":null,"publishedAt":"2026-10-08T10:49:15.000Z"},{"id":"rel_UeQaf7nBbU4kgnSv5lvbj","title":"Why Databricks can’t match ClickHouse Cloud for real-time analytics","path":"/release/rel_UeQaf7nBbU4kgnSv5lvbj-why-databricks-can-t-match-clickhouse-cloud-for-real-time-analytics","url":"https://clickhouse.com/blog/clickhouse-vs-databricks-real-time-performance-per-dollar","org":{"slug":"clickhouse","name":"ClickHouse","avatarUrl":"https://media.releases.sh/orgs/clickhouse.png","githubHandle":"ClickHouse"},"product":null,"importance":null,"composition":null,"publishedAt":"2026-10-06T12:26:14.000Z"}]},{"heading":"Maintenance cadence and smaller fixes","anchor":"maintenance-cadence-and-smaller-fixes","lede":"ClickHouse's version streams continued their steady weekly churn, with stable and LTS branches across the 26.3, 26.7, 26.8, and 26.9 lines all picking up patches — routine maintenance rather than headline features, but worth a look if you pin to an LTS.","releaseIds":["rel_uF9siCCeWA9jepg8kb4Fi","rel_bUpgxqTp3T04nlrvgktl3"],"releases":[{"id":"rel_uF9siCCeWA9jepg8kb4Fi","title":"1.13.26 (core) / 0.29.26 (libraries)","path":"/release/rel_uF9siCCeWA9jepg8kb4Fi-1-13-26-core-0-29-26-libraries","url":"https://github.com/dagster-io/dagster/releases/tag/1.13.26","org":{"slug":"dagster","name":"Dagster","avatarUrl":"https://media.releases.sh/orgs/dagster.jpg","githubHandle":"dagster-io"},"product":null,"importance":null,"composition":null,"publishedAt":"2026-10-09T23:08:50.000Z"},{"id":"rel_bUpgxqTp3T04nlrvgktl3","title":"Remove several organization members at once","path":"/release/rel_bUpgxqTp3T04nlrvgktl3-remove-several-organization-members-at-once","url":"https://www.tinybird.co/docs/changelog/2026-10-09-october-week-two","org":{"slug":"tinybird","name":"Tinybird","avatarUrl":"https://media.releases.sh/orgs/tinybird.png","githubHandle":"tinybirdco"},"product":null,"importance":null,"composition":null,"publishedAt":"2026-10-09T00:00:00.000Z"}]}]}}