Supporting Diverse ML Systems at Netflix
The Netflix TechBlog
MARCH 7, 2024
In addition to Spark, we want to support last-mile data processing in Python, addressing use cases such as feature transformations, batch inference, and training. We use metaflow.Table to resolve all input shards which are distributed to Metaflow tasks which are responsible for processing terabytes of data collectively.
Let's personalize your content