article thumbnail

How Netflix uses eBPF flow logs at scale for network insight

The Netflix TechBlog

By Alok Tiagi , Hariharan Ananthakrishnan , Ivan Porto Carrero and Keerti Lakshminarayan Netflix has developed a network observability sidecar called Flow Exporter that uses eBPF tracepoints to capture TCP flows at near real time. After several iterations of the architecture and some tuning, the solution has proven to be able to scale.

Network 325
article thumbnail

Machine Learning for a Better Developer Experience

The Netflix TechBlog

Erica Sinclair is helping us get LSH probabilities right Dimensionality reduction uses linear algebra or artificial neural networks to place semantically similar words, sentences, and log lines near to each other in a new vector space, using representations known as embeddings. 0.3, -0.5, -0.7, and “problem authenticating” might be [0.1,

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Write Optimized Spark Code for Big Data Applications

DZone

PySpark is the Python API for Apache Spark , which allows Python developers to write Spark applications using Python instead of Scala or Java. In addition, pySpark applications can be tuned to optimize performance and achieve better execution time, scalability, and resource utilization.

Big Data 161
article thumbnail

Snap: a microkernel approach to host networking

The Morning Paper

Snap: a microkernel approach to host networking Marty et al., This paper describes the networking stack, Snap , that has been running in production at Google for the last three years+. Pony Express, as we saw earlier, is a ground-up implementation of networking primitives. SOSP’19. It reminds me of ZeroMQ.

Network 92
article thumbnail

What is RASP? Why runtime application self-protection is important, and how to do it right

Dynatrace

RASP capabilities aim to close the gap left by application security testing and network perimeter controls such as web application firewalls (WAFs). Conversely, a decentralized approach protects application servers using multiple firewalls to protect against attacks that may have penetrated the network.

Tuning 228
article thumbnail

Mastering MongoDB® Timeout Settings

Scalegrid

MongoDB drivers provide several options for Mongo clients to handle different network timeout errors that may occur during usage. The default time-outs can significantly influence the behavior of your application when there are network errors.

Java 130
article thumbnail

AWS re:Invent 2017: How Netflix Tunes EC2

Brendan Gregg

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Our team looks after the BaseAMI, kernel tuning, OS performance tools and profilers, and self-service tools like Vector. Networking. We help where we can. schedtool –B PID. File System.

Tuning 61