Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Or even on a plane.

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

FEBRUARY 4, 2021

As a discipline, SRE focuses on improving software system reliability across key categories including availability, performance, latency, efficiency, capacity, and incident response. SRE applies DevOps principles to developing systems and software that help increase site reliability and performance. Solving for SR.

Engineering 254

Engineering DevOps Government Latency 254

The Netflix TechBlog

APRIL 27, 2023

High Level Architecture The idea, at a high level, was to avoid the need to query the Atlas database almost entirely and transition most alert queries to streaming evaluation. First and foremost, we have successfully alleviated our initial scalability problem with the polling based architecture. OK, Results?

Storage 288

Storage Cache Metrics Database 288

ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications. The recently announced CXL3.0

Latency 52

Latency Hardware Cache Architecture 52

The Netflix TechBlog

MARCH 4, 2024

In this blog post, we present our project on Auto Remediation, which integrates the currently used rule-based classifier with an ML service and aims to automatically remediate failed jobs without human intervention. Auto Remediation generates recommendations by considering both performance (i.e., Multi-objective optimizations.

Tuning 210

Tuning Efficiency Big Data Engineering 210

Dynatrace

FEBRUARY 4, 2021

As a discipline, SRE focuses on improving software system reliability across key categories including availability, performance, latency, efficiency, capacity, and incident response. SRE applies DevOps principles to developing systems and software that help increase site reliability and performance. Solving for SR.

Engineering 176

Engineering DevOps Government Latency 176

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. As it turns out, for the large majority of Netflix use cases, its performance is far from optimal.

Cache 251

Cache Latency Airlines Logistics 251

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

ACM Sigarch

MARCH 18, 2019

This Part 1 discusses Bottleneck Analysis and Little’s Law, while Part 2 presents the M/M/1 Queue. To this end, we present three simple models that we find useful like Amdahl’s Law, split here into two blog posts. How many buffers are needed to track pending requests as a function of needed bandwidth and expected latency?

Systems 60

Systems Latency Performance Analytics 60

The Netflix TechBlog

AUGUST 30, 2021

System Setup Architecture The following diagram summarizes the architecture description: Figure 1: Event-sourcing architecture of the Device Management Platform. A timeline of the transition from Spring KafkaListener to Alpakka-Kafka is presented here for a better understanding of the motivations for the transition.

Latency 213

Latency Traffic Transportation Hardware 213

ACM Sigarch

MARCH 25, 2019

Part 1 previously discussed Bottleneck Analysis and Little’s Law, while this post (Part 2) presents the M/M/1 Queue. It also presented Bottleneck Analysis and Little’s Law that can give initial answers to questions like: What is the maximum throughput through several subsystems in series and parallel? and 1/S as ?.

Systems 53

Systems Latency Performance C++ 53

Adrian Cockcroft

AUGUST 1, 2022

photo by Adrian I gave a talk at Monitorama in Portland Oregon in June, which set out the idea that carbon is just another metric to monitor, and that in a few years most of the monitoring and performance tuning tools are going to be reporting and optimizing for carbon alongside latency, throughput, availability and cost.

AWS 52

AWS Virtualization DevOps Latency 52

John McCalpin

DECEMBER 6, 2016

The Xeon Phi x200 (Knights Landing) has a lot of modes of operation (selected at boot time), and the latency and bandwidth characteristics are slightly different for each mode. I will discuss the performance characteristics of Cache mode at a later date. MCDRAM maximum latency (ns) 156.1 MCDRAM maximum latency (ns) 156.1

Latency 40

Latency Cache Testing Systems 40

InfoQ

APRIL 15, 2024

The presenter shared the lessons learned from evolving and operating the platform, including cluster management and library versioning. At the QCon London 2024 conference, Félix GV from LinkedIn discussed the AI/ML platform powering the company’s products. By Rafal Gancarz

Artificial Intelligence 106

Artificial Intelligence Big Data Data Engineering Latency 106

Brendan Gregg

JULY 2, 2021

Here are the top ten tools you can run and present as a generic BPF observability dashboard, along with suggested visualizations: Tool Shows Visualization. biolatency Disk I/O latency histogram heat map. runqlat CPU scheduler latency heat map. biolatency Disk I/O latency histogram heat map. opensnoop Files opened table.

Latency 145

Latency Cache Energy Systems 145

The Morning Paper

JUNE 13, 2019

HotOS’19 is presenting me with something of a problem as there are so many interesting looking papers in the proceedings this year it’s going to be hard to cover them all! “ For instance, Facebook applications issue tens-of-trillions of inference queries per day with varying performance, accuracy, and cost constraints.”

Hardware 58

Hardware Latency Serverless Energy 58

CSS - Tricks

JULY 25, 2019

This article is from my friend Ben who runs Calibre , a tool for monitoring the performance of websites. Now that Google uses page speed as a ranking factor, many organizations have become laser-focused on performance. To understand how these changes affect us from a performance perspective, we need to grasp the underlying technology.

Google 71

Google Engineering Speed Mobile 71

Scalegrid

DECEMBER 21, 2023

With its widespread use in modern application architectures, understanding the ins and outs of Redis® monitoring is essential for any tech professional. Key Takeaways Redis® monitoring is essential for safeguarding performance, reliability, and security.

Strategy 130

Strategy Monitoring Latency DevOps 130

The Netflix TechBlog

JUNE 13, 2023

Our previous blog post presented replay traffic testing — a crucial instrument in our toolkit that allows us to implement these transformations with precision and reliability. Canaries also provide an opportunity to measure system performance under different load conditions, allowing us to identify and resolve any performance bottlenecks.

Traffic 279

Traffic Metrics Systems Strategy 279

Scalegrid

MARCH 14, 2024

The architecture usually integrates several private, public, and on-premises infrastructures. Key Components of Hybrid Cloud Infrastructure A hybrid cloud architecture usually merges a public Infrastructure-as-a-Service (IaaS) platform with private computing assets and incorporates tools to manage these combined environments.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

John McCalpin

OCTOBER 16, 2016

I will be talking about the technology and market trends that have driven changes in deployed HPC systems, with a particular emphasis on the increasing relative performance cost of memory accesses (vs arithmetic). McCalpin Presents “Memory Bandwidth and System Balance in HPC Systems”.

Architecture 40

Architecture Systems Technology Technology 40

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. We expanded pipeline support to serve our studio/content-development use cases, which had different latency and resiliency requirements as compared to the traditional streaming use case. divide the input video into small chunks 2.

Processing 229

Processing Media Latency Innovation 229

The Netflix TechBlog

FEBRUARY 9, 2021

Plus, the architecture of the Edge tier was evolving to a PaaS (platform as a service) model, and we had some tough decisions to make about how, and where, to handle identity token handling. The system architecture now takes the form of: Notice that tokens never traverse past the Edge gateway / EAS boundary. We are serving over 2.5

Architecture 221

Architecture Latency Servers Website 221

Scalegrid

FEBRUARY 8, 2024

Distributed Storage Architecture Distributed storage systems are designed with a core framework that includes the main system controller, a data repository for the system, and a database. Durability Availability Fault tolerance These combined outcomes help minimize latency experienced by clients spread across different geographical regions.

Storage 130

Storage Systems Big Data Azure 130

The Netflix TechBlog

FEBRUARY 20, 2019

by Jason Koch , with Martin Spier , Brendan Gregg , Ed Hunter Improving the tools available to our engineers to help them diagnose, triage, and work through software performance challenges in the cloud is a key goal for the cloud performance engineering team at Netflix. to the broader community.

Performance 211

Performance Latency Open Source Metrics 211

Adrian Cockcroft

JANUARY 20, 2023

on Myths and Legends of High Performance Computing  — it’s a somewhat light-hearted look at some of the same issues by the leader of the team that built the Fugaku system I mention below. Next generation architectures will use CXL3.0 Next generation architectures will use CXL3.0

Architecture 52

Architecture Latency Benchmarking AWS 52

Dynatrace

NOVEMBER 10, 2022

As companies accelerate digital transformation, cloud services such as AWS Lambda help companies to modernize their application architectures to quickly adapt to the needs of their customers while offloading the operational complexity to their cloud vendor.

Lambda 233

Lambda Serverless AWS Latency 233

The Netflix TechBlog

NOVEMBER 3, 2022

In the time since it was first presented as an advanced Mesos framework, Titus has transparently evolved from being built on top of Mesos to Kubernetes, handling an ever-increasing volume of containers. The original assumptions and architectural choices were no longer viable.

Cache 224

Cache Latency Traffic Systems 224

Brendan Gregg

JULY 2, 2021

Here are the top ten tools you can run and present as a generic BPF observability dashboard, along with suggested visualizations: Tool Shows Visualization 1. biolatency Disk I/O latency histogram heat map 5. runqlat CPU scheduler latency heat map 10. biolatency Disk I/O latency histogram heat map 5.

Open Source 40

Open Source Latency Cache Energy 40

The Netflix TechBlog

MARCH 1, 2021

It supports both high throughput services that consume hundreds of thousands of CPUs at a time, and latency-sensitive workloads where humans are waiting for the results of a computation. The subsystems all communicate with each other asynchronously via Timestone, a high-scale, low-latency priority queuing system.

Serverless 228

Serverless Media Latency Social Media 228

Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.” Note that the class size is limited to about 100, so that I’ll be able to interact with most attendees directly.

Latency 51

Latency C++ Hardware Performance 51

Alex Russell

MAY 9, 2022

Despite advances in browser tooling , automated evaluation , lab tools , guidance , and runtimes , however, teams struggle to deliver even decent performance with today's popular frameworks. What is Performance? It may seem a silly question, but what is performance, exactly?

Performance 86

Performance Latency Metrics Engineering 86

Smashing Magazine

AUGUST 3, 2023

How We Optimized Performance To Serve A Global Audience How We Optimized Performance To Serve A Global Audience Liran Cohen 2023-08-03T10:00:00+00:00 2023-08-03T13:06:00+00:00 I work for Bookaway , a digital travel brand. Large preview ) We’ve known for a long time that fast page performance influences search engine rankings.

Performance 74

Performance Cache Traffic Metrics 74

John McCalpin

APRIL 2, 2020

This was a keynote presentation at the “2nd International Workshop on Performance Modeling: Methods and Applications” (PMMA16), June 23, 2016, Frankfurt, Germany (in conjunction with ISC16 ). This data is from the 2007 presentation.

Benchmarking 59

Benchmarking Performance Latency Architecture 59

Alex Russell

JANUARY 30, 2024

The usual caveats also apply: Performance is a deep and nuanced domain, and much can go wrong beyond content size and composition. How sites manage resources after-load can have a big impact on perceived performance. Until and unless teams have better data about their performance, the global baseline budget should be enforced.

Performance 90

Performance Network Mobile Speed 90

The Netflix TechBlog

DECEMBER 21, 2020

At this scale, we can gain a significant amount of performance and cost benefits by optimizing the storage layout (records, objects, partitions) as the data lands into our warehouse. We built AutoOptimize to efficiently and transparently optimize the data and metadata storage layout while maximizing their cost and performance benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

Dynatrace

DECEMBER 22, 2021

With observability, teams can understand what part of a system is performing poorly and how to correct the problem. Metrics are measures of critical system values, such as CPU utilization or average write latency to persistent storage. Traces provide performance data about tasks that are performed by invoking a series of services.

Artificial Intelligence 178

Artificial Intelligence Metrics Architecture DevOps 178