article thumbnail

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and…

The Netflix TechBlog

Now, imagine yourself in the role of a software engineer responsible for a micro-service which publishes data consumed by few critical customer facing services (e.g. To improve data accuracy, we decided to leverage AWS S3 access logs to identify entity relationships not been captured by our traditional ingestion process.

article thumbnail

The Back-to-Basics Readings of 2012 - All Things Distributed

All Things Distributed

In Proceedings of the Eighteenth Symposium on Operating Systems Principles (SOSP-18), Banff, Canada, October, 2001. Sep 7 - Adaptive load sharing in homogeneous distributed systems , D Eager, ED Lazowska and J Zahorjan - IEEE transactions on software engineering, 1986. Lorie, G.F. Putzolu, and I.L. Nijssen ed.,