Too Big for DAG Factories? — Calvin Hendryx-Parker

Conference: EuroPython 2023

Year: 2023

[EuroPython 2023 — South Hall 2B on 2023-07-21] https://ep2023.europython.eu/session/too-big-for-dag-factories Do you need to transform, optimize and scale your data workflow? In this talk, we’ll review use cases, and you’ll learn how to dynamically generate thousands of DAGs (Directed Acyclic Graphs) with Airflow. This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License http://creativecommons.org/licenses/by-nc-sa/4.0/