The Netflix TechBlog

OCTOBER 19, 2020

Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Our tactical approach was to use Netflix-specific libraries for collecting traces from Java-based streaming services until open source tracer libraries matured.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

The Netflix TechBlog

DECEMBER 17, 2019

There are several open source CDC projects, often using the same underlying libraries, database APIs, and protocols. No locks on tables are ever acquired, which prevent impacting write traffic on the source database. Hence, downstream consumers receive change events as they occur on a source.

Database 197

Database Traffic Transportation Open Source 197

The Netflix TechBlog

DECEMBER 17, 2019

There are several open source CDC projects, often using the same underlying libraries, database APIs, and protocols. No locks on tables are ever acquired, which prevent impacting write traffic on the source database. Hence, downstream consumers have confidence to receive change events as they occur on a source.

Database 212

Database Traffic Transportation Open Source 212

The Netflix TechBlog

JULY 26, 2021

As of now, CDC sources have been implemented for data stores at Netflix (MySQL, Postgres). CDC events can also be sent to Data Mesh via a Java Client Producer Library. Operational Reporting Pipeline Example Iceberg Sink Apache Iceberg is an open source table format for huge analytics datasets.

Big Data 253

Big Data Government Analytics Processing 253

The Netflix TechBlog

JULY 30, 2019

and beyond By Anoop Panicker and Kishore Banala Conductor is a workflow orchestration engine developed and open-sourced by Netflix. This allows us to proactively push changes to the open source version while ensuring that the changes are fully functional and well-tested.

Lambda 189

Lambda Media Open Source Metrics 189