Sept. 13, 2022

E01: Data Orchestration w/ Nick Schrock

E01: Data Orchestration w/ Nick Schrock

Get an update from Nick Schrock on the dagster project. This episode discusses the world of data orchestration at large, when and how to implement dagster, and the broader competitive landscape.

Highlights:
[0:34] The Dagster project and the problems it solves
[3:05] Software defined assets and how they work 
[4:55] Example of how this can be implemented 
[6:30] Promotion of Dagster pipelines from development to production
[10:34] Dagster cloud overview 
[13:15] When to adopt a data orchestrator 
[14:23] Will data orchestration be subsumed into larger data platforms or remain standalone? 
[18:10] The competitive landscape of data orchestration

👉 👉 Don't forget to join us at Data Council Austin - where hundreds of data geeks, founders & investors join each other in building the future of data.