The Netflix TechBlog

OCTOBER 15, 2019

Data Pipeline using Delta In the following sections, we are going to describe the Delta-Connector that connects to a datastore and publishes CDC events to the Transport Layer, which is a real-time data transportation infrastructure routing CDC events to Kafka topics. In addition, we support Cassandra (multi-master).

Transportation 192

Transportation Architecture Processing Storage 192

The Netflix TechBlog

JULY 26, 2021

The Journey In the past few years, Netflix Studio has gone through few iterations of data movement approaches. In the initial stage, data consumers set up ETL pipelines directly pulling data from databases. End-to-End Schema Evolution Schema is a key component of Data Mesh. When an upstream schema evolves (e.g.

Big Data 253

Big Data Government Analytics Processing 253

All Things Distributed

APRIL 4, 2017

After migrating, database queries that took six seconds now take three seconds in their AWS infrastructure. AWS is helping them reach their goal of becoming the leader in sustainable transport. flights, allowing the airline to expand twelvefold to cope with the spike in traffic that it experienced at the time.

AWS 116

AWS Airlines Latency Games 116