article thumbnail

How Netflix uses eBPF flow logs at scale for network insight

The Netflix TechBlog

Flow Exporter The Flow Exporter is a sidecar that uses eBPF tracepoints to capture TCP flows at near real time on instances that power the Netflix microservices architecture. The choice of transport protocols like GRPC, HTTPS & UDP is runtime dependent on characteristics of the instance placement. What is BPF?

Network 325
article thumbnail

Three smart log ingestion strategies in Dynatrace (without OneAgent)

Dynatrace

While engaging the automatic instrumentation of the Dynatrace OneAgent makes log ingestion automatic and scalable , our customers have set up multiple other log ingestion methods. Syslog is a popular standard for transporting and Ingesting log messages. Log ingestion strategy no. 1: Welcome syslog, with the help of Fluentd.

Strategy 185
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Plan Your Multi Cloud Strategy

Scalegrid

This process thoroughly assesses factors like cost-effectiveness, security measures, control levels, scalability options, customization possibilities, performance standards, and availability expectations. Choosing the Right Cloud Services Choosing the right cloud services is crucial in developing an efficient multi cloud strategy.

Strategy 130
article thumbnail

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and…

The Netflix TechBlog

In the rest of this blog, we will a) touch on the complexity of Netflix cloud landscape, b) discuss lineage design goals, ingestion architecture and the corresponding data model, c) share the challenges we faced and the learnings we picked up along the way, and d) close it out with “what’s next” on this journey.

article thumbnail

Kubernetes in the wild report 2023

Dynatrace

Through effortless provisioning, a larger number of small hosts provide a cost-effective and scalable platform. Specifically, they provide asynchronous communications within microservices architectures and high-throughput distributed systems. The different infrastructure setup reflects economic and technical considerations.

article thumbnail

Cherami: Uber Engineering’s Durable and Scalable Task Queue in Go

Uber Engineering

Cherami is a distributed, scalable, durable, and highly available message queue system we developed at Uber Engineering to transport asynchronous tasks.

article thumbnail

Netflix Drive

The Netflix TechBlog

In the future posts, we will do an architectural deep dive into the several components of Netflix Drive. Netflix Drive aims to solve this problem of exposing different namespaces and attaching appropriate access control to help build a scalable, performant, globally distributed platform for storing and retrieving pertinent assets.

Media 174