Dagster Blog

Built a tiered AI classification system, human review workflow, and Dagster orchestration for data governance. Classified a million Snowflake columns in production in nine days.

A letter from Nick Schrock, founder and creator of Dagster, announcing Prefect's acquisition of Dagster.

Some of the most interesting Dagster projects come from the community. This post highlights creative community-built applications.

A complete guide with all the insights, tips, and some predictions for the data platform engineer, just like an Almanack provides, with practical information for daily life.

Mature orchestration environments often work operationally while still leaving critical data dependencies implicit. This post introduces the Orchestration Maturity Model, explains the architectural ceiling of job-centric systems, and shows how Dagster's asset-aware approach…

Some of the most interesting Dagster projects come from the community. This post highlights creative community-built applications ranging from public data exploration and infrastructure monitoring to research automation and internal tooling, along with why their creators chose…

Text-to-analytics promises self-service access to data, but adoption depends on usability, governance, and trust. In this guest post, Brooklyn Data explains how it evaluated Compass, deployed it on top of Snowflake, and enabled teams to answer operational questions directly in…

Snowflake increasingly handles transformation and data freshness internally through features like Dynamic Tables and Cortex. Dagster complements Snowflake by providing orchestration, lineage, automation, and cost visibility across your broader data platform from SQL-defined…

We adopted Astral's new Python type checker, ty, to speed up type checking in the Dagster monorepo. The performance gains were dramatic, but the bigger surprise was that ty caught real runtime bugs Pyright missed. Here's what we learned migrating a large Python codebase…

A complete guide with all the insights, tips, and some predictions for the data platform engineer, just like an Almanack provides, with practical information for daily life.

The Dagster+ Terraform provider lets platform teams manage deployments, access controls, alerting, and more as code. Define entire environments declaratively, review changes through pull requests, and integrate Dagster+ into your existing infrastructure workflows.

Introduces Dagster skills, partitioned asset checks, state backed components, virtual assets, and stronger integrations.

We built a lightweight evaluation framework to quantitatively measure the effectiveness of the Dagster Skills, and these are our findings.