The Netflix TechBlog

AUGUST 30, 2021

For example, when running tests, the state of the device will change from “available for testing” to “in test.” This means that it must at the very least be unit- and functional-testable for rapid and iterative feedback-driven development, and the code must be reasonably ergonomic to lower the learning curve for new maintainers.

Latency 213

Latency Traffic Transportation Cloud 213

Adrian Cockcroft

JANUARY 29, 2023

The mean and percentile measurements hide this structure, but the rest of this post will show how the structure can be measured and analyzed so that you can figure out a useful model of your system, understand what is driving the long tail of latencies and come up with better SLAs and measures of capacity.

Lambda 98

Lambda Latency Cache C++ 98

Brendan Gregg

JULY 2, 2021

Here are the top ten tools you can run and present as a generic BPF observability dashboard, along with suggested visualizations: Tool Shows Visualization. biolatency Disk I/O latency histogram heat map. runqlat CPU scheduler latency heat map. biolatency Disk I/O latency histogram heat map. opensnoop Files opened table.

Latency 145

Latency Cache Energy Systems 145

CSS Wizardry

OCTOBER 16, 2023

What is the availability, configurability, and efficacy of each? ?️ Plotted on the same horizontal axis of 1.6s, the waterfalls speak for themselves: 201ms of cumulative latency; 109ms of cumulative download. 4,362ms of cumulative latency; 240ms of cumulative download. And do any of our previous decisions dictate our options?

Cache 291

Cache Latency Strategy Speed 291

Smashing Magazine

AUGUST 20, 2021

Jamstack CMS: The Past, The Present and The Future. Jamstack CMS: The Past, The Present and The Future. However, unlike the early days of the web, static sites are no longer limited to developers working in a code editor. The benefit of doing this is the entire site’s source code can live in Git. Mike Neumegen.

Ecommerce 139

Ecommerce Website Government Internet 139

Dynatrace

MAY 21, 2024

Observability data presents executives with new opportunities to achieve this, by creating incremental value for cloud modernization , improved business analytics , and enhanced customer experience. That’s because it does not require any pre-prepared schemas, and access to cold/hot storage is fully automatic and with zero latency.

Technology 130

Technology Technology Analytics Storage 130

The Netflix TechBlog

JUNE 13, 2023

Our previous blog post presented replay traffic testing — a crucial instrument in our toolkit that allows us to implement these transformations with precision and reliability. We can determine A/B test membership in either device application or backend code and selectively invoke new code paths and services.

Traffic 279

Traffic Metrics Systems Strategy 279

Brendan Gregg

JULY 2, 2021

Here are the top ten tools you can run and present as a generic BPF observability dashboard, along with suggested visualizations: Tool Shows Visualization 1. biolatency Disk I/O latency histogram heat map 5. runqlat CPU scheduler latency heat map 10. biolatency Disk I/O latency histogram heat map 5. at the time.

Open Source 40

Open Source Latency Cache Energy 40

KeyCDN

SEPTEMBER 12, 2019

The PHP library for the API is available on GitHub. The main reason is because it decreases the latency to the user where they are located by serving your images from a POP physically closest to them. If the file is present, they will follow the instructions but if no file is present, they will scan everything.

Social Media 106

Social Media Media Google Website 106

Brendan Gregg

AUGUST 29, 2021

biolatency From [bcc], this eBPF tool shows a latency histogram of disk I/O. The developers can also rework the code with the memory constraint in mind to improve performance (e.g., An r_wait of 33 ms is kinda high, and likely due to the queueing (avgqu-sz). They are largeish I/O, about 128 Kbytes (divide rkB/s by r/s). ## 3.

Cache 40

Cache C++ AWS Systems 40

The Netflix TechBlog

MARCH 1, 2021

It supports both high throughput services that consume hundreds of thousands of CPUs at a time, and latency-sensitive workloads where humans are waiting for the results of a computation. Local development tools including specialized test runners, code generators, and a command line interface. Productivity?—?Local Delivery?—?A

Serverless 228

Serverless Media Latency Social Media 228

Scalegrid

MARCH 14, 2024

Effective hybrid cloud management requires robust tools and techniques for centralized administration, policy enforcement, cost management, and modern infrastructure practices like Infrastructure-as-Code (IaC) and containers. It should offer user-friendly operation. Capabilities for handling diverse data management functions are necessary.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.” If you’re interested in attending, please check out the links, and I look forward to meeting and re-meeting many of you there.

Latency 51

Latency C++ Hardware Performance 51

The Netflix TechBlog

FEBRUARY 20, 2019

by Jason Koch , with Martin Spier , Brendan Gregg , Ed Hunter Improving the tools available to our engineers to help them diagnose, triage, and work through software performance challenges in the cloud is a key goal for the cloud performance engineering team at Netflix. or “are there noisy neighbors affecting my container task?”.

Performance 211

Performance Latency Open Source Metrics 211

The Netflix TechBlog

AUGUST 29, 2023

Since there were no existing solutions available, we needed to build them ourselves. To improve availability, we designed systems where components could fail separately and avoid single points of failure. Eureka and Ribbon presented a simple but powerful interface, which made adopting them easy.

Traffic 220

Traffic Latency Cloud C++ 220

The Netflix TechBlog

FEBRUARY 9, 2021

When we merge these two concepts together and present them to the customer, we have the plan selection page (shown above). This implies that the presentation layer should be void of any business logic and should simply be responsible for rendering data that is passed to it. The database contains the plans, prices and offers.

Engineering 142

Engineering Scalability Architecture Innovation 142

The Netflix TechBlog

OCTOBER 27, 2020

The data warehouse is not designed to serve point requests from microservices with low latency. Therefore, we must efficiently move data from the data warehouse to a global, low-latency and highly-reliable key-value store. Figure 1 shows how we use Bulldozer to move data at Netflix. Moving data with Bulldozer at Netflix.

Latency 243

Latency Storage Big Data Tuning 243

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The broken Java stacks turned out to be beneficial: They helped group together the os::javaTimeMillis() calls which otherwise might have have been scattered on top of different Java code paths, appearing as thin stacks everywhere.

Speed 126

Speed Java AWS Virtualization 126

The Morning Paper

NOVEMBER 8, 2020

USENIX is a nonprofit organisation committed to making content and research freely available – both conference proceedings and the recorded presentations of their events. They needed a table store to power core control plane services, which meant strong guarantees on durability, consistency, and availability.

Virtualization 126

Virtualization Latency Storage Systems 126

The Netflix TechBlog

MARCH 13, 2020

SVT-AV1 codebase status The SVT-AV1 repository includes both an AV1 encoder and decoder, which share a significant amount of the code. SVT-AV1 uses parallelization at several stages of the encoding process, which allows it to adapt to the number of available cores, including the newest servers with significant core count.

Open Source 154

Open Source Efficiency C++ Speed 154

Alex Russell

APRIL 29, 2021

This post mines publicly available data on the pace of compatibility fixes and feature additions to assess the claim. After 20 years of neck-in-neck competition, often starting from common code lineages, there just isn't that much left to wring out of the system. Count of APIs available from JavaScript by Web Confluence.

Media 145

Media Games Education Engineering 145

Adrian Cockcroft

JANUARY 20, 2023

The next day Jack presented his Turing Award Lecture as the keynote for the event ( HPCwire has a good summary of the whole talk), and later in the the week he was on a panel discussion on “Reinventing HPC” where he repeated the point. I presented a keynote for Sun at Supercomputing 2003 in Phoenix Arizona and included the slide shown below.

Architecture 52

Architecture Latency Benchmarking AWS 52

Dotcom-Montior

MAY 12, 2020

Websites are now more than just the storage and retrieval of information to present content to users. Web monitoring is a comprehensive term that describes the activity of testing a website or web application for its availability and performance. HTTP monitoring allows you to test availability and performance from around the world.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

John McCalpin

APRIL 2, 2020

This was a keynote presentation at the “2nd International Workshop on Performance Modeling: Methods and Applications” (PMMA16), June 23, 2016, Frankfurt, Germany (in conjunction with ISC16 ). This data is from the 2007 presentation.

Benchmarking 59

Benchmarking Performance Latency Architecture 59

All Things Distributed

JUNE 21, 2018

As I have talked about before, one of the reasons why we built Amazon DynamoDB was that Amazon was pushing the limits of what was a leading commercial database at the time and we were unable to sustain the availability, scalability, and performance needs that our growing Amazon.com business demanded. The opposite is true.

Database 167

Database AWS Games Latency 167

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. Designed with High Availability in mind. Providing high availability for real-time events. Preventing code reuse across databases.

Database 212

Database Traffic Transportation Open Source 212

The Morning Paper

JULY 7, 2019

The success of ML-centric projects depends heavily on data availability, quality, and management. Datasets are tagged with information about where they came from and the version of the code used to extract it. Under these conditions, even with separated code, one model’s effectiveness can change as a result of changes in another model.

Software Engineering 92

Software Engineering Engineering Software Software 92

Percona

MAY 15, 2023

In short, any data that is written must be consistent with the data present. Normally this solution requires a full code redesign and could be quite difficult to achieve when it is injected after the initial code architecture definition. In all of them, the sharding key is present, either in the WHERE clause OR as a comment.

Traffic 127

Traffic Scalability Database Servers 127

The Netflix TechBlog

DECEMBER 17, 2019

In order to be supported, a database is required to fulfill a set of features that are commonly available in systems like MySQL, PostgreSQL, MariaDB, and others. Designed with High Availability in mind. Providing high availability for real-time events. This prevents code reuse across databases.

Database 197

Database Traffic Transportation Open Source 197

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The broken Java stacks turned out to be beneficial: They helped group together the os::javaTimeMillis() calls which otherwise might have have been scattered on top of different Java code paths, appearing as thin stacks everywhere.

Speed 52

Speed Java AWS Virtualization 52

Smashing Magazine

MAY 16, 2022

By stepping back and realizing that the fields available have no special bindings to particular types of data, we can see that this technique is also an effective delivery mechanism for any arbitrary data allowing lots of interesting possibilities. Code used to monitor resources (fetch, XHR, images, stylesheets, scripts, HTML, etc.)

Servers 93

Servers Monitoring Cache Network 93

Alex Russell

NOVEMBER 6, 2013

And sneakily it sort of doesn’t look like code. The code to do all of this would be daunting, and you’d never get everyone bought off on the same conventions unless the system provided some. Indeed, documents that present a different view to the crawler than to users are likely spammy. Things those people want.

Engineering 40

Engineering Technology Technology Systems 40

Adrian Cockcroft

APRIL 5, 2023

This proposal seeks to define a standard for real-time carbon and energy data as time-series data that would be accessed alongside and synchronized with the existing throughput, utilization and latency metrics that are provided for the components and applications in computing environments. This format could be coded as a Prometheus Exporter.

Energy 52

Energy Metrics Cloud Operating System 52

The Agile Manager

JULY 29, 2007

This presents both a dilemma and a competitive opportunity for companies today. It takes a great deal of individual skill to solve business problems through IT systems, specifically to model, code and construct solutions that scale, are secure, and are reliable. IT is, fundamentally, a people business.

Government 40

Government Open Source Latency Code 40

Smashing Magazine

AUGUST 3, 2023

HTML Processing Once a web page’s HTML file has been downloaded, the browser begins to process the contents line by line, translating code into the visual website that users interact with. Large preview ) The graph presents the LCP values for the 75th percentile of our users visiting the Route Landing Page group. LCP seconds over time.

Performance 74

Performance Cache Traffic Metrics 74

Alex Russell

JANUARY 30, 2024

This split decision was available via last year's update , but was somewhat buried. Most sites, even those that aspire to be "lived in", feature short median sessions, which means we can't actually justify much in the way of up-front code, and first impressions always matter. In the U.S., This nets out to 2.32

Performance 90

Performance Network Mobile Speed 90

Alex Russell

MAY 9, 2022

This is a complex topic, but to borrow from a recent post , web performance expands access to information and services by reducing latency and variance across interactions in a session, with a particular focus on the tail of the distribution (P75+). Consistent performance matters just as much as low average latency. Who owns this code?

Performance 86

Performance Latency Metrics Engineering 86