The Netflix TechBlog

MARCH 7, 2024

Occasionally, these use cases involve terabytes of data, so we have to pay attention to performance. The user can choose the most suitable tool for manipulating data, such as Pandas or Polars to use a dataframe API, or one of our internal C++ libraries for various high-performance operations.

Systems 226

Systems Media Cache Open Source 226

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. As it turns out, for the large majority of Netflix use cases, its performance is far from optimal.

Cache 251

Cache Latency Airlines Logistics 251

InfoQ

JULY 3, 2023

LinkedIn introduced Couchbase as a centralized caching tier for scaling member profile reads to handle increasing traffic that has outgrown their existing database cluster. The new solution achieved over 99% hit rate, helped reduce tail latencies by more than 60% and costs by 10% annually. By Rafal Gancarz

Cache 82

Cache Latency Traffic Database 82

The Netflix TechBlog

SEPTEMBER 8, 2020

This allows the app to query a list of “paths” in each HTTP request, and get specially formatted JSON (jsonGraph) that we use to cache the data and hydrate the UI. Looking at our high traffic UI screens (like the homepage) allowed us to identify any regressions caused by the endpoint before we enabled it for all our users.

Latency 233

Latency Cache Java Traffic 233

IO River

NOVEMBER 2, 2023

Do continue reading to gain a deep dive into static and dynamic content, its differences, pros, and cons while focusing on the best ways to optimize performance on websites that use such content.‍What Content Delivery Networks (CDNs), web browsers, and proxy servers can store static files in their caches. What is Static Content?Static

Cache 52

Cache Social Media Website Performance Website 52

Randon ASCII

JANUARY 12, 2022

The Xbox 360 CPU had three PowerPC cores and a 1 MB L2 cache and these features are clearly visible on the wafer. In the die picture to the right (which looks to be about 14 mm by 12 mm) you can see the regular pattern of small black rectangles in the bottom right corner – that’s the L2 cache. register files? arithmetic units?)

Cache 126

Cache Latency Benchmarking Hardware 126

Percona

SEPTEMBER 1, 2023

While there is no magic bullet for MySQL performance tuning, there are a few areas that can be focused on upfront that can dramatically improve the performance of your MySQL installation. What are the Benefits of MySQL Performance Tuning? Experiencing database performance issues?

Tuning 52

Tuning Database Performance Hardware 52

Speed Curve

FEBRUARY 5, 2024

That performance golden rule still holds true today. Charlie Vazac introduced server timing in a Performance Calendar post circa 2018. Caching the base page/HTML is common, and it should have a positive impact on backend times. Latency – How much time does it take to deliver a packet from A to B.

Servers 57

Servers Cache Retail Benchmarking 57

The Morning Paper

OCTOBER 4, 2020

Understanding operational 5G: a first measurement study on its coverage, performance and energy consumption , Xu et al., What is the end-to-end throughput and latency, and where are the bottlenecks? Throughput and latency. 5G network paths achieve an average latency of 21.8ms, a 32% reduction on the comparable 4G times.

Energy 130

Energy Latency Performance Network 130

KeyCDN

NOVEMBER 4, 2021

The POP is strategially located within the country and lowers latency overall. KeyCDN is always on the lookout for ways to minimize latency and accelerate asset delivery worldwide. With this new POP, our performance in Latin America has significantly improved and provides a better web experience.

Latency 111

Latency Tuning Cache Traffic 111

IO River

NOVEMBER 2, 2023

Do continue reading to gain a deep dive into static and dynamic content, its differences, pros, and cons while focusing on the best ways to optimize performance on websites that use such content.‍What is Static Content?Static Content Delivery Networks (CDNs), web browsers, and proxy servers can store static files in their caches.

Cache 52

Cache Social Media Website Performance Website 52

Smashing Magazine

NOVEMBER 8, 2021

As developers, we rightfully obsess about the customer experience, relentlessly working to squeeze every millisecond out of the critical rendering path, optimize input latency, and eliminate jank. We work with millions of merchants, and as many companies, we obsess about storefront performance. Ilya Grigorik. 2021-11-08T14:30:00+00:00.

Cache 136

Cache Best Practices Strategy Servers 136

KeyCDN

NOVEMBER 29, 2022

KeyCDN is always looking for ways to minimize latency and accelerate the delivery of assets worldwide. With these new POPs, our performance in Latin America has improved significantly, providing a better web experience. Our mission is to improve web performance continuously, and each POP contributes to that. What's next?

Latency 60

Latency Tuning Cache Traffic 60

Scalegrid

APRIL 16, 2020

Each of these models is suitable for production deployments and high traffic applications, and are available for all of our supported databases, including MySQL , PostgreSQL , Redis™ and MongoDB® database ( Greenplum® database coming soon). This becomes really important for cache solutions like Redis™. Reserved Instances. Expert Tip.

Cloud 242

Cloud Azure AWS Database 242

The Netflix TechBlog

NOVEMBER 9, 2022

A quick canary test was free of errors and showed lower latency, which is expected given that our standard canary setup routes an equal amount of traffic to both the baseline running on 4xl and the canary on 12xl. What’s worse, average latency degraded by more than 50%, with both CPU and latency patterns becoming more “choppy.”

Hardware 363

Hardware Cache Performance Latency 363

The Netflix TechBlog

NOVEMBER 3, 2022

We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe. With traffic growth, a single leader node handling all request volume started becoming overloaded.

Cache 224

Cache Latency Traffic Systems 224

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., Finally, we show that Seer can identify application level design bugs, and provide insights on how to better architect microservices to achieve predictable performance. ASPLOS’19.

Big Data 45

Big Data Cloud Performance Hardware 45

The Netflix TechBlog

JUNE 14, 2023

This blog post will share broadly-applicable techniques (beyond GraphQL) we used to perform this migration. And we definitely couldn’t replay test non-functional requirements like caching and logging user interaction. To determine customer impact, we could compare various metrics such as error rates, latencies, and time to render.

Traffic 353

Traffic Latency Cache Metrics 353

CSS - Tricks

JULY 25, 2019

This article is from my friend Ben who runs Calibre , a tool for monitoring the performance of websites. Now that Google uses page speed as a ranking factor, many organizations have become laser-focused on performance. To understand how these changes affect us from a performance perspective, we need to grasp the underlying technology.

Google 71

Google Engineering Speed Mobile 71

Dean Hume

APRIL 24, 2018

While this may not seem significant for websites with low traffic, as traffic to the site begins to increase, so does the amount of energy consumed. Without effective caching on the client, the server will see an increase in workload, more CPU usage and ultimately increased latency for the end user. Show me the money!

Energy 40

Energy Cache Traffic Website 40

Dean Hume

APRIL 24, 2018

While this may not seem significant for websites with low traffic, as traffic to the site begins to increase, so does the amount of energy consumed. Without effective caching on the client, the server will see an increase in workload, more CPU usage and ultimately increased latency for the end user. Show me the money!

Energy 40

Energy Cache Traffic Website 40

Dean Hume

APRIL 24, 2018

While this may not seem significant for websites with low traffic, as traffic to the site begins to increase, so does the amount of energy consumed. Without effective caching on the client, the server will see an increase in workload, more CPU usage and ultimately increased latency for the end user. Show me the money!

Energy 40

Energy Cache Traffic Website 40

All Things Distributed

NOVEMBER 26, 2013

Cross Region Read Replicas also enable you to serve read traffic for your global customer base from regions that are nearest to them. Cross Region Read Replicas also make it even easier for our global customers to scale database deployments to meet the performance demands of high-traffic, globally disperse applications.

Cloud 145

Cloud AWS Traffic Latency 145

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis and Memcached both provide high performance with sub-millisecond response times. Choosing between Redis and Memcached hinges on specific application requirements.

Cache 130

Cache Storage Scalability Architecture 130

Rigor

DECEMBER 19, 2019

Reading time 4 min It’s important for both technical and business teams to understand the different web performance monitoring options that are available as well as their various use cases and the benefits of each. Understanding Web Performance Monitoring Methodologies. AB Test the Performance Impact of Third Parties.

Monitoring 40

Monitoring Benchmarking Website Traffic 40

Smashing Magazine

AUGUST 3, 2023

How We Optimized Performance To Serve A Global Audience How We Optimized Performance To Serve A Global Audience Liran Cohen 2023-08-03T10:00:00+00:00 2023-08-03T13:06:00+00:00 I work for Bookaway , a digital travel brand. It increases our visibility and enables us to draw a steady stream of organic (or “free”) traffic to our site.

Performance 74

Performance Cache Traffic Metrics 74

Rigor

JULY 2, 2019

Either way, redirection increases the amount of time it takes for your site to render, and you should minimize its use to optimize page performance. Redirection increases the amount of time it takes for your site to render, and you should minimize its use to optimize page performance. webperf #perfmatters Click To Tweet.

Mobile 60

Mobile Traffic Google Latency 60

IO River

NOVEMBER 2, 2023

They need to deliver impeccable performance without breaking the bank.According to recent industry statistics, global streaming has seen an uptick of 30% in the past year, underscoring the importance of efficient CDN architecture strategies. Fundamentally, internet traffic can be broadly categorized into static and dynamic content.

Architecture 52

Architecture Performance Internet Internet 52

IO River

NOVEMBER 2, 2023

They need to deliver impeccable performance without breaking the bank.According to recent industry statistics, global streaming has seen an uptick of 30% in the past year, underscoring the importance of efficient CDN architecture strategies. Fundamentally, internet traffic can be broadly categorized into static and dynamic content.Â

Architecture 52

Architecture Performance Internet Internet 52

IO River

NOVEMBER 2, 2023

A low-cost CDN may not always be as reliable and high-performing as a high-cost one. Therefore, you need to make sure you have the right balance between costs and performance & reliability according to your business needs.Here are some questions to ask yourself before choosing a CDN:How important is the price to you?

Infrastructure 52

Infrastructure Traffic Cache Strategy 52

IO River

NOVEMBER 2, 2023

A low-cost CDN may not always be as reliable and high-performing as a high-cost one. Therefore, you need to make sure you have the right balance between costs and performance & reliability according to your business needs.Here are some questions to ask yourself before choosing a CDN:How important is the price to you?

Infrastructure 52

Infrastructure Traffic Cache Strategy 52

The Morning Paper

NOVEMBER 14, 2019

Taiji: managing global user traffic for large-scale internet services at the edge Xu et al., It’s another networking paper to close out the week (and our coverage of SOSP’19), but whereas Snap looked at traffic routing within the datacenter, Taiji is concerned with routing traffic from the edge to a datacenter. SOSP’19.

Traffic 42

Traffic Internet Internet Latency 42

Percona

MARCH 20, 2023

When deciding what to pick, there are many things to consider, like where the proxy needs to be, if it “just” needs to redirect the connections, or if more features need to be in, like caching and filtering, or if it needs to be integrated with some MySQL embedded automation. Given that, there never was a single straight answer.

Games 124

Games Latency Traffic Cache 124

Scalegrid

FEBRUARY 8, 2024

Durability Availability Fault tolerance These combined outcomes help minimize latency experienced by clients spread across different geographical regions. Opting for synchronous replication within distributed storage brings about reinforced consistency and integrity of data, but also bears higher expenses than other forms of replicating data.

Storage 130

Storage Systems Big Data Azure 130

IO River

NOVEMBER 2, 2023

A CDN (Content Delivery Network) is a network of geographically distributed servers that brings web content closer to where end users are located, to ensure high availability, optimized performance and low latency. The result would be a performance drop in the end users’ experience, often causing the application to become unusable.

Best Practices 52

Best Practices Strategy Traffic Virtualization 52

IO River

NOVEMBER 2, 2023

‍Just as a well-coordinated airport directs flights to multiple runways based on traffic and weather conditions, a CDN with Multiple Origins Load Balancing ensures that web traffic is distributed across various data centers, optimizing performance and reliability. ‍But how does it decide where to send this traffic?

Traffic 52

Traffic Cache Servers Latency 52

Alex Russell

MARCH 6, 2021

Back in 2016, I gave a talk outlining the causes and effects of the terrible performance of web apps built using popular tools on the fastest-growing device segment: low-end to mid-range Android phones. Poor performance has a compound effect on user expectations at an ecosystem level. Live by the link, die by the link.

Performance 124

Performance Network Cache Metrics 124