Remove AWS Remove Efficiency Remove Transportation Remove Tuning
article thumbnail

How Netflix uses eBPF flow logs at scale for network insight

The Netflix TechBlog

Challenges The cloud network infrastructure that Netflix utilizes today consists of AWS services such as VPC, DirectConnect, VPC Peering, Transit Gateways, NAT Gateways, etc and Netflix owned devices. The choice of transport protocols like GRPC, HTTPS & UDP is runtime dependent on characteristics of the instance placement.

Network 325
article thumbnail

Building Netflix’s Distributed Tracing Infrastructure

The Netflix TechBlog

We earned the trust of our engineers by developing empathy for their operational burden and by focusing on providing efficient tracer library integrations in runtime environments. Our engineering teams tuned their services for performance after factoring in increased resource utilization due to tracing. Storage: don’t break the bank!

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and…

The Netflix TechBlog

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and Efficiency By: Di Lin , Girish Lingappa , Jitender Aswani Imagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question?—?“Can

article thumbnail

DBLog: A Generic Change-Data-Capture Framework

The Netflix TechBlog

There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. The database is sending them to a transport that DBLog can consume. We use the term ‘ change log’ for that transport. The destination may be a datastore or an external API. Supporting Relational Databases.

Database 197
article thumbnail

DBLog: A Generic Change-Data-Capture Framework

The Netflix TechBlog

There are services at Netflix that use RDBMS kind of databases such as MySQL or PostgreSQL via AWS RDS. The database is sending them to a transport that DBLog can consume. We use the term ‘ change log’ for that transport. The destination may be a datastore or an external API. Supporting Relational Databases.

Database 212
article thumbnail

Measuring Carbon is Not Enough?—?Unintended Consequences

Adrian Cockcroft

Buildings, food and transport have a much bigger carbon footprint than IT globally. In the simplest case, you have a growing workload, and you optimize it to run more efficiently so that you don’t need to buy or rent additional hardware, so your carbon footprint stays the same, but the carbon per transaction or operation is going down.

Energy 52