The Netflix TechBlog

MARCH 5, 2024

Reduced tail latencies In both our GRPC and DGS Framework services, GC pauses are a significant source of tail latencies. That’s particularly true of our GRPC clients and servers, where request cancellations due to timeouts interact with reliability features such as retries, hedging and fallbacks.

Latency 228

Latency Java Tuning Efficiency 228

The Netflix TechBlog

MAY 4, 2023

The first phase involves validating functional correctness, scalability, and performance concerns and ensuring the new systems’ resilience before the migration. These include Quality-of-Experience(QoE) measurements at the customer device level, Service-Level-Agreements (SLAs), and business-level Key-Performance-Indicators(KPIs).

Traffic 339

Traffic Latency Tuning Systems 339

High Scalability

FEBRUARY 17, 2021

Redis Server: 5.07, x86/64. MongoDB server: 4.4.2, BangDB server: 2.0.0, We note that for MongoDB update latency is really very low (low is better) compared to other dbs, however the read latency is on the higher side. Again Yugabyte latency is quite high. The latency table for test D is as below.

Benchmarking 308

Benchmarking Latency C++ Database 308

Alex Russell

FEBRUARY 28, 2022

It's being reposted here for completeness, but if you care about web performance, make sure to check out the whole series and get subscribed to the RSS feed to avoid missing any of next year's posts. The predominant answer: a unified theory of web performance. What, in particular, is "web performance"? How do we do it?

Performance 104

Performance Latency Architecture Network 104

Speed Curve

FEBRUARY 5, 2024

That performance golden rule still holds true today. Server-timing headers are a key tool in understanding what's happening within that black box of Time to First Byte (TTFB). Cue server-timing headers Historically, when looking at page speed, we've had the tendency to ignore TTFB when trying to optimize the user experience.

Servers 57

Servers Cache Retail Benchmarking 57

IO River

NOVEMBER 2, 2023

A content delivery network (CDN) is a distributed network of servers strategically located across multiple geographical locations to deliver web content to end users more efficiently. When an edge server goes down, end users in the affected region may experience an increase in latency for that specific location.

Architecture 52

Architecture Cache Performance Latency 52

IO River

NOVEMBER 2, 2023

‍A content delivery network (CDN) is a distributed network of servers strategically located across multiple geographical locations to deliver web content to end users more efficiently. CDNs cache content on edge servers distributed globally, reducing the distance between users and the content they want.‍CDNs

Architecture 52

Architecture Cache Performance Latency 52

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 140

Performance Latency Hardware Storage 140

Percona

JUNE 22, 2023

As a MySQL database administrator, keeping a close eye on the performance of your MySQL server is crucial to ensure optimal database operations. A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance.

Performance 104

Performance Monitoring Traffic Database 104

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Or even on a plane.

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

DECEMBER 27, 2022

When organizations implement SLOs, they can improve software development processes and application performance. SLOs can be a great way for DevOps and infrastructure teams to use data and performance expectations to make decisions, such as whether to release and where engineers should focus their time. SLOs improve software quality.

Software 264

Software Software Benchmarking Latency 264

Dynatrace

DECEMBER 4, 2023

AI model observability plays a crucial role in achieving this by addressing these key aspects: Model performance and reliability: Evaluating the model’s ability to provide accurate and timely responses, ensuring stability, and assessing domain-specific semantic accuracy. Maintained under the Apache 2.0

Open Source 258

Open Source Latency Metrics Java 258

Scalegrid

DECEMBER 14, 2023

How the MongoDB timeout is set up can significantly affect your application’s performance, no matter if you are an experienced MongoDB user or just starting with NoSQL databases. Typical applications are interacting with different database servers based on the business logic.

Java 130

Java Network Servers Database 130

Dynatrace

APRIL 7, 2023

Dynatrace is a launch partner in support of AWS Lambda Response Streaming , a new capability enabling customers to improve the efficiency and performance of their Lambda functions. Customers can use AWS Lambda Response Streaming to improve performance for latency-sensitive applications and return larger payload sizes.

Lambda 215

Lambda AWS Serverless Latency 215

CSS Wizardry

AUGUST 7, 2019

A lot of people surmise that TTFB is merely time spent on the server, but that is only a small fraction of the true extent of things. The first—and often most surprising for people to learn—thing that I want to draw your attention to is that TTFB counts one whole round trip of latency. But what else is TTFB?

Latency 269

Latency Ecommerce Servers Mobile 269

Dynatrace

JUNE 7, 2023

Furthermore, tools like LangChain leverage large language models (LLM) as one of their basic building blocks for creating AI agents (think of AI agents as APIs that perform a series of chat interactions that target a desired outcome) which perform complex and potentially large queries against an LLM like GPT-4.

Monitoring 164

Monitoring Latency Metrics Azure 164

Scalegrid

APRIL 28, 2020

High performance. Does it affect latency? Yes, you can see an increase in latency. So, if you’re hosting your application in AWS or Azure and move your database to DigitalOcean, you will see an increase in latency. Meltdown Performance Impact on MongoDB: AWS, Azure & DigitalOcean. Simple pricing.

Azure 344

Azure AWS Database Latency 344

Dynatrace

MAY 31, 2023

With so many of their transactions occurring online, customers are becoming more demanding, expecting websites and applications to always perform perfectly. There are now many more applications, tools, and infrastructure variables that impact an application’s performance and availability.

Best Practices 222

Best Practices DevOps Latency Metrics 222

Dynatrace

MAY 17, 2023

Validation tasks are then extended left to cover performance testing and release validation in a pre-production environment. More precisely, this team uses AWS Fault Injection Simulator (FIS) to run fault injection to improve the application’s performance and resiliency. The queries are depicted below (sensitive data has been removed).

DevOps 186

DevOps Traffic Latency Best Practices 186

The Morning Paper

OCTOBER 4, 2020

Understanding operational 5G: a first measurement study on its coverage, performance and energy consumption , Xu et al., What is the end-to-end throughput and latency, and where are the bottlenecks? Throughput and latency. 5G network paths achieve an average latency of 21.8ms, a 32% reduction on the comparable 4G times.

Energy 130

Energy Latency Performance Network 130

Scalegrid

NOVEMBER 20, 2019

By having appropriate indexes on your MySQL tables, you can greatly enhance the performance of SELECT queries. During this time, you are also likely to experience a degraded performance of queries as your system resources are busy in index-creation work as well. Performance Benefits of Rolling Index Creation. EC2 instance m4.large

Best Practices 239

Best Practices Latency Tuning Database 239

Smashing Magazine

SEPTEMBER 28, 2022

Five Data-Loading Patterns To Improve Frontend Performance. Five Data-Loading Patterns To Improve Frontend Performance. When it comes to performance, you shouldn’t be stingy. The resource loading waterfall is a cascade of files downloaded from the network server to the client to load your website from start to finish.

Cache 125

Cache Performance Servers Social Media 125

Dynatrace

OCTOBER 10, 2022

Despite the name, serverless computing still uses servers. This means companies can access the exact resources they need whenever they need them, rather than paying for server space and computing power they only need occasionally. If servers reach maximum load and capacity in-house, something has to give before adding new services.

Serverless 165

Serverless Infrastructure Lambda Latency 165

Scalegrid

JANUARY 19, 2024

Recovering from a MongoDB rollback involves locating rollback files, using mongorestore to load data into a separate server, cleansing unneeded data, and importing the data back into the primary cluster, coupled with ongoing monitoring and maintenance of replica sets to maintain system health.

Database 130

Database Network Servers Monitoring 130

SQL Shack

JULY 10, 2019

Introduction In-memory technologies are one of the greatest ways to improve performance and combat contention in computing today. By removing disk-based storage and the challenge of copying data in and out of memory, query speeds in SQL Server can be improved by orders of magnitude.

Servers 79

Servers Latency Storage Speed 79

Dynatrace

JANUARY 31, 2024

This blog post explores how AI observability enables organizations to predict and control costs, performance, and data reliability. Data dependencies and framework intricacies require observing the lifecycle of an AI-powered application end to end, from infrastructure and model performance to semantic caches and workflow orchestration.

Cache 205

Cache Azure Infrastructure Monitoring 205

Dynatrace

APRIL 25, 2023

It helps developers and operators identify and troubleshoot issues, optimize performance and improve user experience. However, serverless applications have unique characteristics that make observability more difficult than in traditional server-based applications. Scale automatically based on the demand and traffic patterns.

Serverless 207

Serverless Lambda Azure AWS 207

Dynatrace

DECEMBER 15, 2022

The primary goal of ITOps is to provide a high-performing, consistent IT environment. The roles and responsibilities of ITOps team members include the following: A system administrator configures servers, installs applications, monitors the health of the system, and fixes and upgrades hardware. Performance.

Artificial Intelligence 202

Artificial Intelligence DevOps Hardware Virtualization 202

Dynatrace

SEPTEMBER 18, 2020

Sure, cloud infrastructure requires comprehensive performance visibility, as Dynatrace provides , but the services that leverage cloud infrastructures also require close attention. Well-defined APIs are required for managing such microservices and tracking changes in their performance. High latency or lack of responses.

Infrastructure 192

Infrastructure Latency Metrics Analytics 192

Percona

SEPTEMBER 1, 2023

While there is no magic bullet for MySQL performance tuning, there are a few areas that can be focused on upfront that can dramatically improve the performance of your MySQL installation. What are the Benefits of MySQL Performance Tuning? Experiencing database performance issues?

Tuning 52

Tuning Database Performance Hardware 52

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

SQL Performance

SEPTEMBER 17, 2019

Many database administrators find themselves having to support instances of SQL Server Reporting Services (SSRS), or at least the backend databases that are required for SSRS. These topics apply to both SQL Server Reporting Services as well as Power BI Report Server. Installation and support of SSRS can be confusing.

Tuning 67

Tuning Servers Database Best Practices 67

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., This was a chance to talk about other things I've been working on, such as the present and future of hardware performance.

Performance 52

Performance Latency Hardware Storage 52

High Scalability

JANUARY 11, 2022

When the server receives a request for an action (post, like etc.) from a client it performs two parallel operations: i) persisting the action in the data store ii) publish the action in a streaming data store for a pub-sub model. When the server receives a request for an action (post, like etc.) High Level Design. Architecture.

Design 334

Design Media Storage Logistics 334

Dynatrace

APRIL 5, 2021

The 2014 launch of AWS Lambda marked a milestone in how organizations use cloud services to deliver their applications more efficiently, by running functions at the edge of the cloud without the cost and operational overhead of on-premises servers. Optimizing Lambda for performance. What is AWS Lambda? Data entering a stream.

Lambda 180

Lambda AWS Serverless Hardware 180

Dynatrace

MAY 19, 2022

This multinational information technology service and consulting company was asked to help a global automotive manufacturer with the management goal of measuring service flow performance. In their new dashboard, they added dimensions for load, latency, and open problems for each component. Initial SLO management dashboard. Saturation.

Automotive 271

Automotive Latency Architecture Azure 271

CSS Wizardry

APRIL 22, 2020

So, for the last several years, I, along with other performance engineers like me, have been recommending that our clients move over from Gzip and to Brotli instead. Taking a very reductive and simplistic view of how files are transmitted from server to client, we need to look at TCP. Browser Support: A brief interlude. packet loss).

Latency 269

Latency Servers Website Speed 269