Incremental Processing using Netflix Maestro and Apache Iceberg
The Netflix TechBlog
NOVEMBER 20, 2023
For example, a job would reprocess aggregates for the past 3 days because it assumes that there would be late arriving data, but data prior to 3 days isn’t worth the cost of reprocessing. Backfill: Backfilling datasets is a common operation in big data processing. append, overwrite, etc.).
Let's personalize your content