The Netflix TechBlog

MARCH 7, 2024

Since its inception , Metaflow has been designed to provide a human-friendly API for building data and ML (and today AI) applications and deploying them in our production infrastructure frictionlessly. Occasionally, these use cases involve terabytes of data, so we have to pay attention to performance.

Systems 226

Systems Media Cache Open Source 226

IO River

NOVEMBER 2, 2023

A content delivery network (CDN) is a distributed network of servers strategically located across multiple geographical locations to deliver web content to end users more efficiently. The Four Pillars of CDN Design‍CDN architecture can be broken down into several building blocks, known as the Four Pillars of CDN Design.

Architecture 52

Architecture Cache Performance Latency 52

Smashing Magazine

SEPTEMBER 28, 2022

Five Data-Loading Patterns To Improve Frontend Performance. Five Data-Loading Patterns To Improve Frontend Performance. When it comes to performance, you shouldn’t be stingy. On design systems, UX, web performance and CSS/JS. Active Memory Caching. Using the cache as permanent storage is an anti-pattern.

Performance 125

Performance Cache Servers Social Media 125

Percona

SEPTEMBER 1, 2023

While there is no magic bullet for MySQL performance tuning, there are a few areas that can be focused on upfront that can dramatically improve the performance of your MySQL installation. What are the Benefits of MySQL Performance Tuning? A finely tuned database processes queries more efficiently, leading to swifter results.

Tuning 52

Tuning Database Performance Hardware 52

IO River

NOVEMBER 2, 2023

‍A content delivery network (CDN) is a distributed network of servers strategically located across multiple geographical locations to deliver web content to end users more efficiently. CDNs cache content on edge servers distributed globally, reducing the distance between users and the content they want.‍CDNs

Architecture 52

Architecture Cache Performance Latency 52

Dynatrace

SEPTEMBER 13, 2023

This is a set of best practices and guidelines that help you design and operate reliable, secure, efficient, cost-effective, and sustainable systems in the cloud. The framework comprises six pillars: Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, and Sustainability.

AWS 246

AWS Efficiency Azure Cloud 246

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Or even on a plane.

Performance 110

Performance Latency Cache Virtualization 110

Scalegrid

FEBRUARY 8, 2024

Their design emphasizes increasing availability by spreading out files among different nodes or servers — this approach significantly reduces risks associated with losing or corrupting data due to node failure. Variations within these storage systems are called distributed file systems.

Storage 130

Storage Systems Big Data Azure 130

Smashing Magazine

AUGUST 3, 2023

How We Optimized Performance To Serve A Global Audience How We Optimized Performance To Serve A Global Audience Liran Cohen 2023-08-03T10:00:00+00:00 2023-08-03T13:06:00+00:00 I work for Bookaway , a digital travel brand. Large preview ) We’ve known for a long time that fast page performance influences search engine rankings.

Performance 74

Performance Cache Traffic Metrics 74

Smashing Magazine

JANUARY 11, 2021

Front-End Performance Checklist 2021. Front-End Performance Checklist 2021. This guide has been kindly supported by our friends at LogRocket , a service that combines frontend performance monitoring , session replay, and product analytics to help you build better customer experiences. Web performance is a tricky beast, isn’t it?

Performance 145

Performance Cache Media Metrics 145

Percona

APRIL 17, 2023

Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. For bare metals, any algorithm among deadline or noop (the performance difference between them is imperceptible) will be better than CFQ.

Best Practices 52

Best Practices Design Tuning Database 52

Dynatrace

JULY 16, 2020

To do that, we need an easy and efficient API access to all of our Dynatrace Environments, without having to create and maintain API access tokens of individual tenants. It wouldn’t scale and it wouldn’t perform either. Highly parallel and performant for any API call and doesn’t introduce much overhead. ? Consolidating the APIs.

Cache 234

Cache Serverless Efficiency Tuning 234

Percona

SEPTEMBER 1, 2023

MySQL server performance can sometimes be perplexing, and if you’ve ever wondered about the role of triggers in influencing your MySQL server’s memory allocation, this post is for you. This can affect the overall performance of your database system, potentially leading to slower response times. What is a Trigger in MySQL?

Cache 63

Cache Database Games Healthcare 63

Percona

JULY 25, 2023

When a new node joins the cluster, SST is performed to receive the data from DONOR to the JOINER. Percona XtraBackup performs crash recovery on the files to make a consistent, usable database again. This search tuple (key) is used to find the record to perform the undo operation. Old design (until Percona XtraBackup 8.0.33-27):

Cache 89

Cache Benchmarking Servers Design 89

The Morning Paper

JUNE 25, 2019

Designing far memory data structures: think outside the box Aguilera et al., Therefore, if we want to make full use of one-sided far memory, we need to think carefully about the design of our data structures to make that access efficient. Processor caches can help to hide local accesses too, but not remote accesses.

Design 80

Design Cache Hardware Scalability 80

Dynatrace

OCTOBER 4, 2022

While data lakes and data warehousing architectures are commonly used modes for storing and analyzing data, a data lakehouse is an efficient third way to store and analyze data that unifies the two architectures while preserving the benefits of both. A data lakehouse, therefore, enables organizations to get the best of both worlds.

Artificial Intelligence 208

Artificial Intelligence Analytics Storage Government 208

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. As it turns out, for the large majority of Netflix use cases, its performance is far from optimal.

Cache 251

Cache Latency Airlines Logistics 251

The Morning Paper

MAY 23, 2019

Compress objects, not cache lines: an object-based compressed memory hierarchy Tsai & Sanchez, ASPLOS’19. One of the important attributes of their design was easy and rapid deployment across an existing fleet. If we compress objects instead of cache lines though, we can get to a 56% compression ratio (c).

Cache 61

Cache Benchmarking Hardware Java 61

Dynatrace

OCTOBER 7, 2021

Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. The first benefit is simplicity. AWS serverless offerings. Amazon divides its serverless solutions into three broad categories with 12 specific services.

Serverless 280

Serverless AWS Lambda Storage 280

Dynatrace

APRIL 21, 2022

Analyzing user experience to ensure uniform performance after migration. The Azure Well-Architected Framework is a set of guiding tenets organizations can use to evaluate architecture and implement designs that will scale over time. Performance efficiency. Performance Efficiency. Operational excellence.

Azure 188

Azure Monitoring Virtualization Metrics 188

Smashing Magazine

NOVEMBER 8, 2021

We work with millions of merchants, and as many companies, we obsess about storefront performance. We obsess even more about finding the optimal balance between performance, capabilities, and merchants’ business objectives. I work at Shopify, an all-in-one commerce platform to start, run, and grow a business. Large preview ).

Cache 135

Cache Best Practices Strategy Servers 135

IO River

NOVEMBER 2, 2023

They need to deliver impeccable performance without breaking the bank.According to recent industry statistics, global streaming has seen an uptick of 30% in the past year, underscoring the importance of efficient CDN architecture strategies. Given its unchanging nature, static content is ideal for caching.

Architecture 52

Architecture Performance Internet Internet 52

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

MARCH 8, 2020

This paper describes the design decisions behind the Snowflake cloud-based data warehouse. This paper presents Snowflake design and implementation along with a discussion on how recent changes in cloud infrastructure (emerging hardware, fine-grained billing, etc.) From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

Percona

MARCH 20, 2023

When designing an architecture, many components need to be considered before deciding on the best solution. In this scenario, it is also crucial to be efficient in resource utilization and scaling with frugality. This is due to the multiplexing and the very efficient way ProxySQL uses to deal with high load.

Games 125

Games Latency Traffic Cache 125

IO River

NOVEMBER 2, 2023

They need to deliver impeccable performance without breaking the bank.According to recent industry statistics, global streaming has seen an uptick of 30% in the past year, underscoring the importance of efficient CDN architecture strategies. HLS ensures users get the optimal video quality based on their internet performance.

Architecture 52

Architecture Performance Internet Internet 52

ACM Sigarch

MAY 31, 2023

Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications. Jason Lowe-Power (UC Davis) discussed smart memory management and the need for an efficient interface for it.

Latency 52

Latency Hardware Cache Architecture 52

IO River

NOVEMBER 2, 2023

CDN’s Effectiveness: Static Vs Dynamic ContentBack in the day, a CDN’s primary function revolved around caching static content and delivering it efficiently to end-users. It’s a static file, and CDN can cache it, enabling quick delivery to various locations. The same movie file is served to millions of users worldwide.

Cache 52

Cache Traffic Games Network 52

Smashing Magazine

JULY 18, 2022

You are now “Head of Performance” at Repairing Magazine, the most serious competitor to Smashing Magazine. Your job for today is to implement this feature with the best possible performances. However, it’s not energy-efficient to render the article for each and every request. Congratulations On Your New Job. More after jump!

Cache 114

Cache Website Energy Servers 114

Smashing Magazine

JANUARY 6, 2020

Front-End Performance Checklist 2020 [PDF, Apple Pages, MS Word]. Front-End Performance Checklist 2020 [PDF, Apple Pages, MS Word]. Web performance is a tricky beast, isn’t it? How do we actually know where we stand in terms of performance, and what our performance bottlenecks exactly are? Vitaly Friedman.

Performance 145

Performance Cache Network Metrics 145

Percona

FEBRUARY 1, 2023

PostgreSQL is a fantastic database, but if you’re storing images, video, audio files, or other large data objects, you need to “toast” them to get optimal performance. This post will look at using The Oversized-Attribute Storage Technique (TOAST) to improve performance and scalability.

Storage 96

Storage Scalability Strategy Performance 96

Smashing Magazine

MAY 12, 2022

How To Use Google CrUX To Analyze And Compare The Performance Of JS Frameworks. How To Use Google CrUX To Analyze And Compare The Performance Of JS Frameworks. In particular, the increase in the amount of downloaded JavaScript can have a direct impact on website performance. Dan Shappir. 2022-05-12T09:30:00+00:00.

Google 127

Google Performance Website Mobile 127

Randon ASCII

SEPTEMBER 30, 2022

A twenty-second delay for recording a forty-second clip is a pretty bad efficiency ratio. RuntimeBroker was CPU bound and was spending most of its time in a single thread that was busy performing queries on the results of a crawl over some directory: The next step was to look at the File I/O graph to see what directory was being scanned.

Software 130

Software Software Cache Hardware 130

The Netflix TechBlog

SEPTEMBER 8, 2020

This allows the app to query a list of “paths” in each HTTP request, and get specially formatted JSON (jsonGraph) that we use to cache the data and hydrate the UI. Latencies The old api service was running on the same “machine” that also cached a lot of video metadata (by design). This meant that data that was static (e.g.

Latency 233

Latency Cache Java Traffic 233

Smashing Magazine

JANUARY 7, 2019

Front-End Performance Checklist 2019 [PDF, Apple Pages, MS Word]. Front-End Performance Checklist 2019 [PDF, Apple Pages, MS Word]. Web performance is a tricky beast, isn’t it? How do we actually know where we stand in terms of performance, and what our performance bottlenecks exactly are? Vitaly Friedman.

Performance 103

Performance Cache Metrics Network 103

The Morning Paper

FEBRUARY 6, 2020

.’ Stateless is fine until you need state, at which point the coarse-grained solutions offered by current platforms limit the kinds of application designs that work well. On the Cloudburst design teams’ wish list: A running function’s ‘hot’ data should be kept physically nearby for low-latency access.

Lambda 98

Lambda Serverless Cache Latency 98

ScaleOut Software

MAY 15, 2014

For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. Given all this, we thought it would be a good opportunity to see how we are doing relative to the competition, and in particular, relative to Microsoft’s AppFabric caching for Windows on-premise servers.

Cache 40

Cache Servers Network Design 40