Incremental Processing using Netflix Maestro and Apache Iceberg
The Netflix TechBlog
NOVEMBER 20, 2023
For example, a job would reprocess aggregates for the past 3 days because it assumes that there would be late arriving data, but data prior to 3 days isn’t worth the cost of reprocessing. Backfill: Backfilling datasets is a common operation in big data processing. data arrives too late to be useful).
210 
Let's personalize your content