The Netflix TechBlog

NOVEMBER 22, 2019

This entertaining romp through the tech stack serves as an introduction to how we think about and design systems, the Netflix approach to operational challenges, and how other organizations can apply our thought processes and technologies. We explore all the systems necessary to make and stream content from Netflix.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

This entertaining romp through the tech stack serves as an introduction to how we think about and design systems, the Netflix approach to operational challenges, and how other organizations can apply our thought processes and technologies. We explore all the systems necessary to make and stream content from Netflix.

AWS 100

AWS Entertainment Open Source Benchmarking 100

ACM Sigarch

MARCH 25, 2019

Part 1 previously discussed Bottleneck Analysis and Little’s Law, while this post (Part 2) presents the M/M/1 Queue. It also presented Bottleneck Analysis and Little’s Law that can give initial answers to questions like: What is the maximum throughput through several subsystems in series and parallel? and 1/S as ?.

Systems 53

Systems Latency Performance C++ 53

Percona

MAY 2, 2023

The answer does not consider the queue or latency of the sample, which could indicate a disk with issues. Answer : No, ChatGPT is an AI language model developed by OpenAI and is not designed to replace a MySQL DBA job. In your sample, the %util values range from 1.30 The answer could be better. Q: I have a server with 2 NUMA cores.

Social Media 122

Social Media Database Servers Cache 122

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on. I also wrote about these topics in detail for my recent [Systems Performance 2nd Edition] book.

Performance 52

Performance Latency Hardware Storage 52

Smashing Magazine

NOVEMBER 8, 2021

As developers, we rightfully obsess about the customer experience, relentlessly working to squeeze every millisecond out of the critical rendering path, optimize input latency, and eliminate jank. Continue reading below ↓ Meet Smart Interface Design Patterns , with Vitaly Friedman. Ilya Grigorik. 2021-11-08T14:30:00+00:00.

Cache 135

Cache Best Practices Strategy Servers 135

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

The Netflix TechBlog

SEPTEMBER 3, 2021

Remote calls are never free; they impose extra latency, increase probability of an error, and consume network bandwidth. How can we achieve a similar functionality when designing our gRPC APIs? There are a number of utilities and conventions on how to use this message when it is present in an RPC request.

Design 245

Design Java Efficiency Code 245

CSS Wizardry

OCTOBER 16, 2023

Compressing them over the network: Which compression algorithm, if any, will we use? Plotted on the same horizontal axis of 1.6s, the waterfalls speak for themselves: 201ms of cumulative latency; 109ms of cumulative download. 4,362ms of cumulative latency; 240ms of cumulative download. Read the complete test methodology.

Cache 291

Cache Latency Strategy Speed 291

The Morning Paper

JUNE 13, 2019

HotOS’19 is presenting me with something of a problem as there are so many interesting looking papers in the proceedings this year it’s going to be hard to cover them all! The following figure highlights how just one of these variables, batch size, impacts throughput and latency on ResNet50. HotOS’19. Usability expectations.

Hardware 58

Hardware Latency Serverless Energy 58

cdemi

JUNE 10, 2017

Simply put, a Byzantine Fault is a fault that presents different symptoms to different observers. Several system architectures were designed that implement Byzantine Fault Tolerance. Because these are real-time systems, their Byzantine fault tolerance solutions must have very low latency. Achieving Byzantine Fault Tolerance.

Blockchain 62

Blockchain Latency Systems C++ 62

Dotcom-Montior

DECEMBER 8, 2021

ITSM defines how teams design, create, and deliver their services. An organization’s response to an incident, whether we are talking about downtime, security breaches or cyber-attacks, or even prolonged latency and repeated errors, is critical to the continued success of the business and trust from the customer or end user.

Social Media 90

Social Media Monitoring Latency DevOps 90

Scalegrid

FEBRUARY 8, 2024

Their design emphasizes increasing availability by spreading out files among different nodes or servers — this approach significantly reduces risks associated with losing or corrupting data due to node failure. Variations within these storage systems are called distributed file systems.

Storage 130

Storage Systems Big Data Azure 130

Speed Curve

SEPTEMBER 4, 2013

Here's the slides from my presentation at the Auckland Web Dev Nights meetup. The network constraints and what makes the web slow? The network constraints and what makes the web slow? Bandwidth, latency and it's fundamental impact on the speed of the web. How to make your website faster. Optimization tools and techniques.

Speed 40

Speed Benchmarking Latency Mobile 40

The Netflix TechBlog

NOVEMBER 22, 2019

This entertaining romp through the tech stack serves as an introduction to how we think about and design systems, the Netflix approach to operational challenges, and how other organizations can apply our thought processes and technologies. We explore all the systems necessary to make and stream content from Netflix.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Percona

JULY 20, 2023

We often forget or take for granted the network hops involved and the additional overhead it creates on the overall performance. Meanwhile, Hans-Jürgen Schönig’s presentation , which brought up the old discussion of Unix socket vs. TCP/IP connection, triggered me to write about other aspects of network impact on performance.

Network 64

Network Performance Latency Servers 64

Scalegrid

MARCH 14, 2024

When delving into the networking aspect of a hybrid cloud deployment, complexities arise due to the requirement of linking or expanding existing on-premises network architectures into the cloud sphere. We will examine each of these elements in more detail. It should offer user-friendly operation.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

The Netflix TechBlog

NOVEMBER 3, 2022

In the time since it was first presented as an advanced Mesos framework, Titus has transparently evolved from being built on top of Mesos to Kubernetes, handling an ever-increasing volume of containers. This blog post presents how our current iteration of Titus deals with high API call volumes by scaling out horizontally.

Cache 224

Cache Latency Traffic Systems 224

Percona

MARCH 29, 2023

In this blog, we will discuss both data and network-level compression offered in MongoDB. We will discuss snappy and zstd for data block and zstd compression in a network. When this data block is read, it decompresses it in memory and presents it to the incoming request. I am using PSMDB 6.0.4 provides higher compression rates.

Storage 111

Storage Network Open Source Latency 111

Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. By default, most Linux installs use the CFQ ( Completely-Fair Queue ) scheduler. Two other schedulers are deadline and noop.

Best Practices 52

Best Practices Design Tuning Database 52

The Netflix TechBlog

FEBRUARY 9, 2021

A few years ago, we decided to address this complexity by spinning up a new initiative, and eventually a new team, to move the complex handling of user and device authentication, and various security protocols and tokens, to the edge of the network, managed by a set of centralized services, and a single team. We are serving over 2.5

Architecture 221

Architecture Latency Servers Website 221

All Things Distributed

AUGUST 16, 2011

There are different considerations when deciding where to allocate resources with latency and cost being the two obvious ones, but compliance sometimes plays an important role as well. The Cloud First strategy is most visible with new Federal IT programs, which are all designed to be â??Cloud Cloud Readyâ??; Recent Entries.

AWS 111

AWS Government Big Data Cloud 111

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. We expanded pipeline support to serve our studio/content-development use cases, which had different latency and resiliency requirements as compared to the traditional streaming use case. divide the input video into small chunks 2.

Processing 229

Processing Media Latency Innovation 229

Tim Kadlec

SEPTEMBER 30, 2015

Alongside of that we have Google’s QUIC which could provide significant reduction in latency. We have more focus than ever on motion design on the web. I didn’t think much about accessibility or performance or semantic markup or visual design when I started. Learn how connections are established over the network.

Technology 53

Technology Technology Latency Design 53

The Netflix TechBlog

DECEMBER 21, 2020

This article will list some of the use cases of AutoOptimize, discuss the design principles that help enhance efficiency, and present the high-level architecture. These principles reduce resource usage by being more efficient and effective while lowering the end-to-end latency in data processing. Transparency to end-users.

Storage 203

Storage Latency Efficiency Data Engineering 203

Scalegrid

JANUARY 12, 2024

While managing cloud workloads offers numerous benefits, it also presents several challenges such as security risks, compliance issues, and resource optimization, which can be addressed effectively with tools like ScaleGrid, offering features like encryption, disaster recovery, and real-time resource optimization for diverse databases.

Cloud 130

Cloud Virtualization Storage Efficiency 130

The Netflix TechBlog

FEBRUARY 9, 2021

Before designing a solution it’s important to understand the main product requirements for such a feature: The content needs to be new, relevant, and regional (not all countries have the same catalogue). We need to be able to easily determine what imagery is present for a given platform, region, and language.

Engineering 165

Engineering Storage Latency Entertainment 165

Smashing Magazine

AUGUST 3, 2023

These pages serve as a pivotal tool in our digital marketing strategy, not only providing valuable information about our services but also designed to be easily discoverable through search engines. You need to beware of large HTML files or slow network connections because they can lead to longer download times. LCP seconds over time.

Performance 74

Performance Cache Traffic Metrics 74

Adrian Cockcroft

JANUARY 20, 2023

The next day Jack presented his Turing Award Lecture as the keynote for the event ( HPCwire has a good summary of the whole talk), and later in the the week he was on a panel discussion on “Reinventing HPC” where he repeated the point. I presented a keynote for Sun at Supercomputing 2003 in Phoenix Arizona and included the slide shown below.

Architecture 52

Architecture Latency Benchmarking AWS 52

CSS Wizardry

MARCH 3, 2019

The best request is the one that never happens: in the fight for fast websites, avoiding the network is far better than hitting the network at all. This means that, if the Cache-Control: max-age=60 header is still present, the cached file’s 60 seconds starts again. How is your knowledge of caching and Cache-Control headers?

Cache 264

Cache Latency Strategy Servers 264

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Metrics for each service instance are presented in detailed charts—see the example for ECS below. The example below visualizes average latency by API name and stage for a specific AWS API Gateway.

AWS 135

AWS Metrics IoT Storage 135

Dynatrace

DECEMBER 22, 2019

AWS offers a broad set of global, cloud-based services including computing, storage, networking, Internet of Things (IoT), and many others. Metrics for each service instance are presented in detailed charts—see the example for ECS below. The example below visualizes average latency by API name and stage for a specific AWS API Gateway.

AWS 132

AWS Metrics IoT Storage 132

Percona

DECEMBER 26, 2023

The collected data is aggregated and presented in a single view. This allows for much better data accuracy, especially in the case of high-resolution or unreliable networks. Configuring Grafana For our purposes, the Grafana datasource used in this PoC is also the Postgres data cluster that is generating the data to be monitored.

Benchmarking 124

Benchmarking Metrics C++ Database 124

Alex Russell

JANUARY 30, 2024

It's time once again to update our priors regarding the global device and network situation. seconds on the target device and network profile, consuming 120KiB of critical path resources to become interactive, only 8KiB of which is script. What's changed since last year? and 75KiB of JavaScript. These are generous targets.

Performance 90

Performance Network Mobile Speed 90

Smashing Magazine

AUGUST 22, 2021

As we will see, QUIC and HTTP/3 indeed have great web performance potential, but mainly for users on slow networks. If your average visitor is on a fast cabled or cellular network, they probably won’t benefit from the new protocols all that much. Two-way latency is often called round-trip time (RTT). Congestion Control.

Performance 105

Performance Network Latency Servers 105

Alex Russell

MARCH 6, 2021

Thanks to progress in networks and browsers (but not devices), a more generous global budget cap has emerged for sites constructed the "modern" way: ~100KiB of HTML/CSS/fonts and ~300-350KiB of JS (compressed) is the new rule-of-thumb limit for at least the next year or two. Modern network performance and availability.

Performance 124

Performance Network Cache Metrics 124

Alex Russell

MAY 9, 2022

This is a complex topic, but to borrow from a recent post , web performance expands access to information and services by reducing latency and variance across interactions in a session, with a particular focus on the tail of the distribution (P75+). Consistent performance matters just as much as low average latency.

Performance 86

Performance Latency Metrics Engineering 86