3. Psyberg: Automated end to end catch up
The Netflix TechBlog
NOVEMBER 14, 2023
This helps overwrite data only when required and minimizes unnecessary reprocessing. As seen above, by chaining these Psyberg workflows, we could automate the catchup for late-arriving data from hours 2 and 6. The Data Engineer does not need to perform any manual intervention in this case and can thus focus on more important things!
Let's personalize your content