article thumbnail

How Netflix uses eBPF flow logs at scale for network insight

The Netflix TechBlog

By Alok Tiagi , Hariharan Ananthakrishnan , Ivan Porto Carrero and Keerti Lakshminarayan Netflix has developed a network observability sidecar called Flow Exporter that uses eBPF tracepoints to capture TCP flows at near real time. Without having network visibility, it’s difficult to improve our reliability, security and capacity posture.

Network 325
article thumbnail

Write Optimized Spark Code for Big Data Applications

DZone

In addition, pySpark applications can be tuned to optimize performance and achieve better execution time, scalability, and resource utilization. In this article, we will discuss some tips and techniques for tuning PySpark applications. This can significantly reduce network overhead and improve performance.

Big Data 161
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Observability engineering: Getting Prometheus metrics right for Kubernetes with Dynatrace and Kepler

Dynatrace

For busy site reliability engineers, ensuring system reliability, scalability, and overall health is an imperative that’s getting harder to achieve in ever-expanding, cloud-native, container-based environments. But often, we use additional services and solutions within our environment for backups, storage, networking, and more.

Metrics 177
article thumbnail

Building Netflix’s Distributed Tracing Infrastructure

The Netflix TechBlog

Reconstructing a streaming session was a tedious and time consuming process that involved tracing all interactions (requests) between the Netflix app, our Content Delivery Network (CDN), and backend microservices. Our engineering teams tuned their services for performance after factoring in increased resource utilization due to tracing.

article thumbnail

Plan Your Multi Cloud Strategy

Scalegrid

This process thoroughly assesses factors like cost-effectiveness, security measures, control levels, scalability options, customization possibilities, performance standards, and availability expectations. Choosing the Right Cloud Services Choosing the right cloud services is crucial in developing an efficient multi cloud strategy.

Strategy 130
article thumbnail

Network Automation at Fastly

InfoQ

Ryan Landry, the senior director for TechOps at Fastly, has shared how network automation enables them to manage traffic peaks during popular live-streamed events such as the Super Bowl LIV.

Network 41
article thumbnail

How to Assess MySQL Performance

HammerDB

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For the network, we can use Iperf to assess the network bandwidth between the client and the database server to ensure it will be enough to meet our peak requirement.