Orchestrating Data/ML Workflows at Scale With Netflix Maestro
The Netflix TechBlog
OCTOBER 18, 2022
These include ETL pipelines, ML model training workflows, batch jobs, etc. Similarly, ML model training workflows usually consist of tens of thousands of training jobs within a single workflow. We use Netflix open source project Conductor as a library to manage the workflow state machine in Maestro.
Let's personalize your content