article thumbnail

How Netflix uses eBPF flow logs at scale for network insight

The Netflix TechBlog

Flow Exporter The Flow Exporter is a sidecar that uses eBPF tracepoints to capture TCP flows at near real time on instances that power the Netflix microservices architecture. The choice of transport protocols like GRPC, HTTPS & UDP is runtime dependent on characteristics of the instance placement. What is BPF?

Network 325
article thumbnail

World’s first and only fully automatic observability for Golang services now extended to statically linked Go applications

Dynatrace

With no required recompilation or code changes, you can: Monitor web-scale and highly dynamic microservice architectures including statically as well as dynamically linked Go applications and platform components. From http.Transport documentation : By default, Transport caches connections for future reuse. So stay tuned!

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Delta: A Data Synchronization and Enrichment Platform

The Netflix TechBlog

In Netflix the microservice architecture is widely adopted and each microservice typically handles only one type of data. Kafka & Transport Layer The transport layer of Delta events were built on top of the Messaging Service in our Keystone platform. The architecture of the framework is illustrated in the following Chart.

article thumbnail

Plan Your Multi Cloud Strategy

Scalegrid

Adopting Infrastructure as Code (IaaC) makes transitioning to a multi-cloud architecture more efficient, allowing streamlined setup processes. Consistently evaluating and tuning resource allocations based on use patterns helps prevent overprovisioning and reduces unnecessary expenses.

Strategy 130
article thumbnail

Snap: a microkernel approach to host networking

The Morning Paper

I’m jumping ahead a bit here, but the component of Snap which provides the transport and communications stack is called Pony Express. Rather than reimplement TCP/IP or refactor an existing transport, we started Pony Express from scratch to innovate on more efficient interfaces, architecture, and protocol. Enter Google!

Network 92
article thumbnail

Towards a Reliable Device Management Platform

The Netflix TechBlog

System Setup Architecture The following diagram summarizes the architecture description: Figure 1: Event-sourcing architecture of the Device Management Platform. The RAE is configured to be effectively a router that devices under test (DUTs) are connected to.

Latency 213
article thumbnail

Data Mesh?—?A Data Movement and Processing Platform @ Netflix

The Netflix TechBlog

Overall Architecture The Data Mesh system can be divided into the control plane (Data Mesh Controller) and the data plane (Data Mesh Pipeline). It reads events from the upstream transports and applies some business logic to each of them. An intermediate processor writes data to another transport. Please stay tuned!