Brendan Gregg

JULY 2, 2021

There's an arms race to add eBPF (BPF) to commercial observability products, and in this post I'll describe how to quickly do that. People like to show me their BPF observability products after they have prototyped or built them, but I often wish I had given them advice before they started. You might not even like BPF.

Latency 145

Latency Cache Energy Systems 145

The Netflix TechBlog

NOVEMBER 22, 2019

Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges. We showcase our case studies, open-source tools in benchmarking, and how we ensure that AWS cloud services are serving our needs without compromising on tail latencies.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

Netflix runs dozens of stateful services on AWS under strict sub-millisecond tail-latency requirements, which brings unique challenges. We showcase our case studies, open-source tools in benchmarking, and how we ensure that AWS cloud services are serving our needs without compromising on tail latencies.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Brendan Gregg

AUGUST 18, 2019

For example, iostat(1), or a monitoring agent, may tell you your average disk latency, but not the distribution of this latency. For smaller environments, it can be of more use helping eliminate latency outliers. I [previously] wrote about bpftrace vs other tracers, including [BCC] (BPF Compiler Collection). name global.

Latency 68

Latency C++ Cache Programming 68

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. The call for participation ends on March 2nd 23:59 SGT! Ford, et al., “TCP

Performance 110

Performance Latency Cache Virtualization 110

Brendan Gregg

OCTOBER 8, 2018

It is being developed for BSD, too, where BPF originated. Screenshot: tracing read latency for PID 181: # bpftrace -e 'kprobe:vfs_read /pid == 30153/ { @start[tid] = nsecs; } kretprobe:vfs_read /@start[tid]/ { @ns = hist(nsecs - @start[tid]); delete(@start[tid]); }'. bcc is powerful but laborious to program. I wrote seeksize.d

C++ 110

C++ Virtualization Programming Latency 110

Brendan Gregg

JULY 2, 2021

There's an arms race to add [eBPF] (BPF) to commercial observability products, and in this post I'll describe how to quickly do that. People like to show me their BPF observability products after they have prototyped or built them, but I often wish I had given them advice before they started. You might not even like BPF.

Open Source 40

Open Source Latency Cache Energy 40