Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Or even on a plane.

Performance 110

Performance Latency Cache Virtualization 110

IO River

NOVEMBER 2, 2023

CDNs cache content on edge servers distributed globally, reducing the distance between users and the content they want.‍CDNs use load-balancing techniques to distribute incoming traffic across multiple servers called Points of Presence (PoPs) which distribute content closer to end-users and improve overall performance.

Architecture 52

Architecture Cache Performance Latency 52

IO River

NOVEMBER 2, 2023

When an edge server goes down, end users in the affected region may experience an increase in latency for that specific location. Performance‍The number and distribution of PoPs play a crucial role in performance. Performance‍The number and distribution of PoPs play a crucial role in performance.

Architecture 52

Architecture Cache Performance Latency 52

CSS Wizardry

AUGUST 7, 2019

The first—and often most surprising for people to learn—thing that I want to draw your attention to is that TTFB counts one whole round trip of latency. The reason is because mobile networks are, as a rule, high latency connections. Armed with this knowledge, we can soon understand why TTFB can often increase so dramatically on mobile.

Latency 269

Latency Ecommerce Servers Mobile 269

Dynatrace

JANUARY 31, 2024

While off-the-shelf models assist many organizations in initiating their journeys with generative AI (GenAI), scaling AI for enterprise use presents formidable challenges. This blog post explores how AI observability enables organizations to predict and control costs, performance, and data reliability.

Cache 206

Cache Azure Infrastructure Monitoring 206

Scalegrid

DECEMBER 14, 2023

How the MongoDB timeout is set up can significantly affect your application’s performance, no matter if you are an experienced MongoDB user or just starting with NoSQL databases. Doing so helps ensure optimal performance while maintaining adequate levels of protection against unwanted connection attempts.

Java 130

Java Network Servers Database 130

The Netflix TechBlog

MARCH 4, 2024

In this blog post, we present our project on Auto Remediation, which integrates the currently used rule-based classifier with an ML service and aims to automatically remediate failed jobs without human intervention. Auto Remediation generates recommendations by considering both performance (i.e., Multi-objective optimizations.

Tuning 210

Tuning Efficiency Big Data Engineering 210

Sutter's Mill

FEBRUARY 12, 2024

Presented by Alfasoft. Because “high-performance low-latency” is kind of C++’s bailiwick, and because it’s my course, you’ll be unsurprised to learn that the topics and code focus on C++ and include coverage of modern C++17/20/23 features.

C++ 40

C++ Latency Code Technology 40

Dynatrace

FEBRUARY 4, 2021

As a discipline, SRE focuses on improving software system reliability across key categories including availability, performance, latency, efficiency, capacity, and incident response. SRE applies DevOps principles to developing systems and software that help increase site reliability and performance.

Engineering 256

Engineering DevOps Government Latency 256

Dynatrace

APRIL 25, 2023

It helps developers and operators identify and troubleshoot issues, optimize performance and improve user experience. Higher latency and cold start issues due to the initialization time of the functions. Understanding cold-start behavior is essential to tune your cloud applications cost or performance to meet your operational needs.

Serverless 210

Serverless Lambda Azure AWS 210

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. CFS is widely used and therefore well tested and Linux machines around the world run with reasonable performance.

Cache 251

Cache Latency Airlines Logistics 251

ACM Sigarch

MARCH 18, 2019

This Part 1 discusses Bottleneck Analysis and Little’s Law, while Part 2 presents the M/M/1 Queue. To this end, we present three simple models that we find useful like Amdahl’s Law, split here into two blog posts. How many buffers are needed to track pending requests as a function of needed bandwidth and expected latency?

Systems 60

Systems Latency Performance Analytics 60

John McCalpin

DECEMBER 6, 2016

The Xeon Phi x200 (Knights Landing) has a lot of modes of operation (selected at boot time), and the latency and bandwidth characteristics are slightly different for each mode. I will discuss the performance characteristics of Cache mode at a later date. MCDRAM maximum latency (ns) 156.1 MCDRAM maximum latency (ns) 156.1

Latency 40

Latency Cache Testing Systems 40

Randon ASCII

JANUARY 12, 2022

It was a lot of fun, and the work was appreciated, so a few months before the console shipped I got a present from the leadership of the project – an entire silicon wafer of Xbox 360 CPUs! Back in the day I wrote a lot of benchmarks in order to look for places where the actual performance of the CPU didn’t match what we expected.

Cache 126

Cache Latency Benchmarking Hardware 126

Dynatrace

FEBRUARY 4, 2021

As a discipline, SRE focuses on improving software system reliability across key categories including availability, performance, latency, efficiency, capacity, and incident response. SRE applies DevOps principles to developing systems and software that help increase site reliability and performance.

Engineering 178

Engineering DevOps Government Latency 178

ACM Sigarch

MAY 31, 2023

Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications. However, building and utilizing HCM presents challenges, including interconnecting various memory technologies (e.g.,

Latency 52

Latency Hardware Cache Architecture 52

ACM Sigarch

MARCH 25, 2019

Part 1 previously discussed Bottleneck Analysis and Little’s Law, while this post (Part 2) presents the M/M/1 Queue. It also presented Bottleneck Analysis and Little’s Law that can give initial answers to questions like: What is the maximum throughput through several subsystems in series and parallel? and 1/S as ?.

Systems 53

Systems Latency Performance C++ 53

Percona

NOVEMBER 2, 2023

MongoDB is a dynamic database system continually evolving to deliver optimized performance, robust security, and limitless scalability. Our new eBook, “ From Planning to Performance: MongoDB Upgrade Best Practices ,” guides you through the entire process to ensure your database’s long-term success. In MongoDB 6.x:

Best Practices 86

Best Practices Hardware Tuning Scalability 86

The Netflix TechBlog

APRIL 27, 2023

The fundamental idea behind Telltale is to detect anomalies on SLI metrics (for example, latency, error rates, etc). Finally, we switched Telltale , our holistic application health monitoring system, from polling a metrics cache to using realtime Atlas Streaming.

Storage 288

Storage Cache Metrics Database 288

The Netflix TechBlog

AUGUST 30, 2021

A timeline of the transition from Spring KafkaListener to Alpakka-Kafka is presented here for a better understanding of the motivations for the transition. By the following morning, alerts were received regarding high memory consumption and GC latencies, to the point where the service was unresponsive to HTTP requests.

Latency 213

Latency Traffic Transportation Hardware 213

InfoQ

APRIL 15, 2024

The presenter shared the lessons learned from evolving and operating the platform, including cluster management and library versioning. At the QCon London 2024 conference, Félix GV from LinkedIn discussed the AI/ML platform powering the company’s products. By Rafal Gancarz

Artificial Intelligence 103

Artificial Intelligence Big Data Data Engineering Latency 103

Adrian Cockcroft

AUGUST 1, 2022

photo by Adrian I gave a talk at Monitorama in Portland Oregon in June, which set out the idea that carbon is just another metric to monitor, and that in a few years most of the monitoring and performance tuning tools are going to be reporting and optimizing for carbon alongside latency, throughput, availability and cost.

AWS 52

AWS Virtualization DevOps Latency 52

Speed Curve

FEBRUARY 5, 2024

That performance golden rule still holds true today. Charlie Vazac introduced server timing in a Performance Calendar post circa 2018. Latency – How much time does it take to deliver a packet from A to B. 80% of end-user response time is spent on the front end. However, wider adoption has only just started to take off.

Servers 57

Servers Cache Retail Benchmarking 57

Percona

MAY 2, 2023

Keep in mind that setting the buffer pool size too high may result in other processes on your server competing for memory, which can impact performance. 16) and monitoring the server’s performance. You can then gradually increase or decrease the value to optimize the server’s performance based on your workload.[…]

Social Media 120

Social Media Database Servers Cache 120

The Netflix TechBlog

NOVEMBER 22, 2019

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

December 2 1pm-2pm CMP 326-R Capacity Management Made Easy with Amazon EC2 Auto Scaling Vadim Filanovsky , Senior Performance Engineer & Anoop Kapoor, AWS Abstract :Amazon EC2 Auto Scaling offers a hands-free capacity management experience to help customers maintain a healthy fleet, improve application availability, and reduce costs.

AWS 100

AWS Entertainment Open Source Benchmarking 100

DZone

JUNE 2, 2019

Almost every time I present RSocket to an audience, there will be someone asking the question: "How does RSocket compare to gRPC?" " Today we are going to find out.

Benchmarking 279

Benchmarking Latency Java Scalability 279

Smashing Magazine

NOVEMBER 8, 2021

As developers, we rightfully obsess about the customer experience, relentlessly working to squeeze every millisecond out of the critical rendering path, optimize input latency, and eliminate jank. We work with millions of merchants, and as many companies, we obsess about storefront performance. Ilya Grigorik. 2021-11-08T14:30:00+00:00.

Cache 135

Cache Best Practices Strategy Servers 135

The Morning Paper

JUNE 13, 2019

HotOS’19 is presenting me with something of a problem as there are so many interesting looking papers in the proceedings this year it’s going to be hard to cover them all! “ For instance, Facebook applications issue tens-of-trillions of inference queries per day with varying performance, accuracy, and cost constraints.”

Hardware 58

Hardware Latency Serverless Energy 58

Brendan Gregg

JULY 2, 2021

Here are the top ten tools you can run and present as a generic BPF observability dashboard, along with suggested visualizations: Tool Shows Visualization. biolatency Disk I/O latency histogram heat map. runqlat CPU scheduler latency heat map. biolatency Disk I/O latency histogram heat map. opensnoop Files opened table.

Latency 145

Latency Cache Energy Systems 145

CSS Wizardry

OCTOBER 16, 2023

When serving and storing files on the web, there are a number of different things we need to take into consideration in order to balance ergonomics, performance, and effectiveness. Plotted on the same horizontal axis of 1.6s, the waterfalls speak for themselves: 201ms of cumulative latency; 109ms of cumulative download. It gets worse.

Cache 291

Cache Latency Strategy Speed 291

Dotcom-Montior

DECEMBER 8, 2021

are all prone to performance issues and unexpected outages at some point. Problem management is the process by which the root causes of incidents are permanently fixed, which improves long-term performance and future service deployments. This can also lead to identifying further opportunities where weaknesses may be present.

Social Media 90

Social Media Monitoring Latency DevOps 90

Brendan Gregg

AUGUST 29, 2021

A service team was debugging a performance issue and noticed it coincided with a high rate of paging. I was asked to help, and used a variety of performance tools to solve this including those that use eBPF and Ftrace. biolatency From [bcc], this eBPF tool shows a latency histogram of disk I/O. These are rough notes.

Cache 105

Cache C++ AWS Latency 105

Smashing Magazine

AUGUST 20, 2021

Jamstack CMS: The Past, The Present and The Future. Jamstack CMS: The Past, The Present and The Future. Ben and Mena Trott created MovableType because of a “Dissatisfacion with existing blog CMSes — performance, stability.” Mike Neumegen. 2021-08-20T08:00:00+00:00. 2021-08-20T09:19:47+00:00.

Ecommerce 139

Ecommerce Website Government Internet 139

CSS - Tricks

JULY 25, 2019

This article is from my friend Ben who runs Calibre , a tool for monitoring the performance of websites. Now that Google uses page speed as a ranking factor, many organizations have become laser-focused on performance. To understand how these changes affect us from a performance perspective, we need to grasp the underlying technology.

Google 71

Google Engineering Speed Mobile 71