The Netflix TechBlog

JULY 12, 2019

The Tech Hollow , an OSS technology we released a few years ago, has been best described as a total high-density near cache : Total : The entire dataset is cached on each node?—?there there is no eviction policy, and there are no cache misses. Near : the cache exists in RAM on any instance which requires access to the dataset.

Cache 183

Cache Architecture Latency Engineering 183

Dynatrace

SEPTEMBER 13, 2023

Because Google offers its own Google Cloud Architecture Framework and Microsoft its Azure Well-Architected Framework , organizations that use a combination of these platforms triple the challenge of integrating their performance frameworks into a cohesive strategy. SRG validates the status of the resiliency SLOs for the experiment period.

AWS 236

AWS Efficiency Azure Cloud 236

Smashing Magazine

SEPTEMBER 28, 2022

Every unnecessary bit of JavaScript code you bundle and serve will be more code the client has to load and process. How will you serve blazingly fast code, then? Jamstack is popular with documentation sites that usually compile code to HTML files and host them on the CDN. Active Memory Caching. Caching Schemes.

Performance 127

Performance Cache Servers Social Media 127

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Lambda 98

Lambda Serverless Cache Latency 98

Sutter's Mill

FEBRUARY 13, 2017

Tue-Thu Apr 25-27: High-Performance and Low-Latency C++ (Stockholm). On April 25-27, I’ll be in Stockholm (Kista) giving a three-day seminar on “High-Performance and Low-Latency C++.” If you’re interested in attending, please check out the links, and I look forward to meeting and re-meeting many of you there.

Latency 48

Latency C++ Hardware Performance 48

High Scalability

JULY 20, 2018

That’s mapping applications to the specific architectural choices. The third wing of the architecture piece is the “domain specific system-on-chip.” Cliff Click : The JVM is very good at eliminating the cost of code abstraction, but not the cost of data abstraction. They are very expensive.

Internet 121

Internet Internet Scalability Automotive 121

John McCalpin

APRIL 25, 2023

For most high-end processors these values have remained in the range of 75% to 85% of the peak DRAM bandwidth of the system over the past 15-20 years — an amazing accomplishment given the increase in core count (with its associated cache coherence issues), number of DRAM channels, and ever-increasing pipelining of the DRAMs themselves.

Benchmarking 97

Benchmarking Cache Latency Tuning 97

The Morning Paper

OCTOBER 26, 2020

Helios also serves as a reference architecture for how Microsoft envisions its next generation of distributed big-data processing systems being built. These two narratives of reference architecture and ingestion/indexing system are interwoven throughout the paper. Why do we need a new reference architecture? Emphasis mine ).

Cloud 104

Cloud Big Data Latency Architecture 104

Smashing Magazine

AUGUST 3, 2023

HTML Processing Once a web page’s HTML file has been downloaded, the browser begins to process the contents line by line, translating code into the visual website that users interact with. It also opens up the possibility for more effective use of caching strategies, potentially enhancing load times further.

Performance 75

Performance Cache Traffic Metrics 75

Brendan Gregg

JULY 2, 2021

biolatency Disk I/O latency histogram heat map. cachestat File system cache statistics line charts. runqlat CPU scheduler latency heat map. The architecture is: While the bpftrace binary is installed on all the target systems, the bpftrace tools (text files) live on a web server and are pushed out when needed.

Latency 145

Latency Cache Energy Systems 145

The Symphonia

MAY 22, 2018

I started writing “ Serverless Architectures ” in May 2016. I was a little restricted in my thinking the first time around and I’ve come to see FaaS as something not quite stateless, since caching state in a Lambda instance that might stick around for 5 hours is a perfectly reasonable idea. I thought a few folks might be interested.

Serverless 40

Serverless Architecture Lambda Azure 40

The Morning Paper

SEPTEMBER 10, 2019

That’s hard for many reasons, including the differing trade-offs between throughput and latency that need to be made across the use cases. to understand YouTube video performance) drive tens of thousands of canned (known in advance) queries per second, that need to be served with latency in the tens of milliseconds.

Analytics 75

Analytics Latency Cache Google 75

ScaleOut Software

MAY 15, 2014

We have spent a great deal of time at ScaleOut Software re-architecting our in-memory data grid (IMDG)’s code base to make best use of many cores and large memory. Likewise, object access paths must be heavily multi-threaded and avoid lock contention to minimize access latency and maximize throughput. Please retry later.

Cache 40

Cache Servers Network Design 40

John McCalpin

APRIL 2, 2020

This includes all architectures, all compilers, all operating systems, and all system configurations. Here I assumed a particular analytical function for the amount of memory traffic as a function of cache size to scale the bandwidth time. Many of these applications (e.g., while the second model is within 1%.

Benchmarking 59

Benchmarking Performance Latency Architecture 59

Smashing Magazine

JANUARY 11, 2021

Have we optimized enough with tree-shaking, scope hoisting, code-splitting, and all the fancy loading patterns with intersection observer, progressive hydration, clients hints, HTTP/3, service workers and — oh my — edge workers? It’s much easier to reach performance goals when the code base is fresh or is just being refactored.

Performance 145

Performance Cache Media Metrics 145

Alex Russell

DECEMBER 18, 2022

These devices feature: Eight slow, big.LITTLE ARM cores (A75+A55, or A73+A53) built on last-generation processes with very little cache. The best analouge you can buy for a representative P75 device today are ~$200 Androids from the last year or two, such as the Samsung Galaxy A50 and the Nokia G11. 4GiB of RAM.

Performance 113

Performance Network Mobile Latency 113

The Morning Paper

APRIL 14, 2019

Microarchitectural state of interest includes data and instruction caches, TLBs, branch predictors, instruction- and data-prefetcher state machines, and DRAM row buffers. cache) can be partitioned across domains; for those that are instead time-multiplexed, we have to flush them during domain switches. IPC) input and output channels.

Hardware 44

Hardware Cache Latency Speed 44

IO River

NOVEMBER 2, 2023

CloudFront makes a simple choice here as it offers direct integration with all these services to let you cache responses across its global edge locations. This means that if you wish to switch CDN, you’d have to rewrite a vast amount of code to support a new API.‍‍Sign ‍‍Is Vendor Lock-in a Bad Thing?

Lambda 52

Lambda AWS Cache Website 52

Smashing Magazine

JANUARY 6, 2020

Is it worth exploring tree-shaking, scope hoisting, code-splitting, and all the fancy loading patterns with intersection observer, server push, clients hints, HTTP/2, service workers and — oh my — edge workers? It’s much easier to reach performance goals when the code base is fresh or is just being refactored.

Performance 145

Performance Cache Network Metrics 145

Percona

JULY 17, 2023

Organizations have access to the source code, allowing them to make changes and enhancements as needed. Redis can handle a high volume of operations per second, making it useful for running applications that require low latency. This architecture ensures high availability, fault tolerance, and resilience to failures.

Open Source 75

Open Source Database Scalability Software 75

The Morning Paper

MAY 12, 2019

A typical architecture diagram for one of these services looks like this: Suitably armed with a set of benchmark microservices applications, the investigation can begin! Smaller microservices demonstrated much better instruction-cache locality than their monolithic counterparts. Hardware implications. improving by 43% and up to 2.2x.

Open Source 61

Open Source Hardware Benchmarking Systems 61

CSS - Tricks

JULY 25, 2019

Cache-Headers missing? If you’re interested in a high-level overview of Lighthouse architecture, read this guide from the official repository. Estimated Input Latency. Estimated Input Latency. Where possible, remove unused JavaScript code or focus on only delivering a script that will be run by the current page.

Google 71

Google Engineering Speed Mobile 71

Smashing Magazine

JANUARY 7, 2019

Is it worth exploring tree-shaking, scope hoisting, code-splitting, and all the fancy loading patterns with intersection observer, server push, clients hints, HTTP/2, service workers and — oh my — edge workers? Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms.

Performance 104

Performance Cache Metrics Network 104

John McCalpin

AUGUST 1, 2018

Bandwidth, performance analysis has two recurring themes: How fast should this code (or “simple” variations on this code) run on this hardware? Interacting components in the execution of an MPI job — a brief outline (from memory): The user source code, which contains an ordered set of calls to MPI routines.

Hardware 40

Hardware Transportation Performance Latency 40

IO River

NOVEMBER 2, 2023

CloudFront makes a simple choice here as it offers direct integration with all these services to let you cache responses across its global edge locations. However, the IaC code significantly changes across each CDN provider.For example, the IaC code to provision a CloudFlare CDN and a CloudFront CDN is different in any IaC provider.

Lambda 52

Lambda AWS Cache Website 52

Percona

MAY 15, 2023

Normally this solution requires a full code redesign and could be quite difficult to achieve when it is injected after the initial code architecture definition. Best practices indicate that having ProxySQL closer to the application will be more efficient, especially if we decide to activate the caching feature.

Traffic 122

Traffic Scalability Database Servers 122

Enprowess

SEPTEMBER 7, 2021

The technology develops single-page applications , websites, and backend API services designed with real-time and push-based architectures. has a unit testing framework called Jasmine, which allows unit testing of code during development. with its low latency I/O operations, gives the benefit of ‘No buffering’ to developers.

Open Source 52

Open Source Virtualization Programming Servers 52

ScaleOut Software

JULY 21, 2020

For more than fifteen years, ScaleOut StateServer® has demonstrated technology leadership as an in-memory data grid (IMDG) and distributed cache. Application code is automatically shipped by the client library to the IMDG for execution and runs fully in parallel across all servers for maximum performance.

Analytics 52

Analytics Airlines Cache Scalability 52

ScaleOut Software

JULY 21, 2020

For more than fifteen years, ScaleOut StateServer® has demonstrated technology leadership as an in-memory data grid (IMDG) and distributed cache. Application code is automatically shipped by the client library to the IMDG for execution and runs fully in parallel across all servers for maximum performance.

Analytics 52

Analytics Airlines Cache Scalability 52

The Netflix TechBlog

DECEMBER 17, 2019

This prevents code reuse across databases. This way, log event processing can resume event-by-event afterwards, eventually discovering the watermarks, without ever needing to cache log event entries. The same code is used for MySQL and PostgreSQL and can be used for other similar databases as well. DBLog High Level Architecture.

Database 197

Database Traffic Transportation Open Source 197

Abhishek Tiwari

NOVEMBER 3, 2018

When it comes to innovation, most of CMS solutions are constrained by their legacy architecture (read strong coupling between content management and content presentation) which makes it difficult to serve content to new types of emerging channels such as apps and devices. Eventually, we decided to move them to Jekyll.

Systems 63

Systems Cache Website Network 63

John McCalpin

NOVEMBER 5, 2016

The art and science of microprocessor architecture is a never-ending struggling to balance complexity, verifiability, usability, expressiveness, compactness, ease of encoding/decoding, energy consumption, backwards compatibility, forwards compatibility, and other factors. This includes Haswell and newer cores.

Cache 40

Cache C++ Latency Hardware 40

The Netflix TechBlog

DECEMBER 17, 2019

Preventing code reuse across databases. This way, log event processing can resume event-by-event afterwards, eventually discovering the watermarks, without ever needing to cache log event entries. The same code is used for MySQL and PostgreSQL and can be used for other similar databases as well. DBLog High Level Architecture.

Database 212

Database Traffic Transportation Open Source 212

Brendan Gregg

JULY 2, 2021

biolatency Disk I/O latency histogram heat map 5. cachestat File system cache statistics line charts 7. runqlat CPU scheduler latency heat map 10. The architecture is: While the bpftrace binary is installed on all the target systems, the bpftrace tools (text files) live on a web server and are pushed out when needed.

Open Source 40

Open Source Latency Cache Energy 40

Alex Russell

OCTOBER 22, 2017

One distinct trend is a belief that a JavaScript framework and Single-Page Architecture (SPA) is a must for PWA development. Therefore, while a 150KB image won’t appreciably increase TTI, 150KB of JS will delay interactivity by the time required to: Request the code, including DNS, TCP, HTTP, and decompression overhead.

Performance 68

Performance Benchmarking Network Mobile 68

SQL Server According to Bob

JANUARY 11, 2020

Stable media is commonly physical disk storage, but other devices and certain caching facilities qualify as well. Many high-end disk subsystems provide high-speed cache facilities to reduce the latency of read and write operations. This cache is often supported by a battery-powered backup facility.

Servers 40

Servers Cache Media Hardware 40

All Things Distributed

SEPTEMBER 3, 2013

Choosing your database architecture may be the most critical decision you’ll make and has a disproportionate impact on the performance, scalability, and availability of your app. No single database architecture or solution can meet all of Amazon.com’s or our customers’ needs.

Cache 129

Cache Cloud Performance Retail 129