The Netflix TechBlog

SEPTEMBER 24, 2021

By Xiaomei Liu , Rosanna Lee , Cyril Concolato Introduction Behind the scenes of the beloved Netflix streaming service and content, there are many technology innovations in media processing. Packaging has always been an important step in media processing. The ProRes codec family provides great editing performance and image quality.

Cloud 237

Cloud Media Storage Cache 237

The Morning Paper

MARCH 8, 2020

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. For such workloads, shared-nothing architectures beget high cost, inflexibility, poor performance, and inefficiency, which hurts production applications and cluster deployments. joins) during query processing. joins) during query processing.

Storage 112

Storage Engineering Cache Serverless 112

Percona

MARCH 23, 2023

This blog is in reference to our previous ones for ‘Innodb Performance Optimizations Basics’ 2007 and 2013. Although there have been many blogs about adjusting MySQL variables for better performance since then, I think this topic deserves a blog update since the last update was a decade ago, and MySQL 5.7

Performance 124

Performance Hardware Tuning Storage 124

High Scalability

JANUARY 11, 2022

from a client it performs two parallel operations: i) persisting the action in the data store ii) publish the action in a streaming data store for a pub-sub model. User Feed Service, Media Counter Service) read the actions from the streaming data store and performs their specific tasks. After that, the various services (e.g.

Design 334

Design Media Storage Logistics 334

Smashing Magazine

SEPTEMBER 28, 2022

Five Data-Loading Patterns To Improve Frontend Performance. Five Data-Loading Patterns To Improve Frontend Performance. When it comes to performance, you shouldn’t be stingy. Every unnecessary bit of JavaScript code you bundle and serve will be more code the client has to load and process. Active Memory Caching.

Performance 127

Performance Cache Servers Social Media 127

Scalegrid

JANUARY 25, 2024

Redis® is an in-memory database that provides blazingly fast performance. This makes it a compelling alternative to disk-based databases when performance is a concern. You might already use ScaleGrid hosting for Redis hosting to power your performance-sensitive applications.

Metrics 130

Metrics Monitoring Latency Cache 130

Percona

SEPTEMBER 1, 2023

While there is no magic bullet for MySQL performance tuning, there are a few areas that can be focused on upfront that can dramatically improve the performance of your MySQL installation. What are the Benefits of MySQL Performance Tuning? A finely tuned database processes queries more efficiently, leading to swifter results.

Tuning 52

Tuning Database Performance Hardware 52

Percona

JUNE 22, 2023

As a MySQL database administrator, keeping a close eye on the performance of your MySQL server is crucial to ensure optimal database operations. A monitoring tool like Percona Monitoring and Management (PMM) is a popular choice among open source options for effectively monitoring MySQL performance.

Performance 102

Performance Monitoring Traffic Database 102

Dynatrace

OCTOBER 4, 2022

Data warehouses offer a single storage repository for structured data and provide a source of truth for organizations. However, organizations must structure and store data inputs in a specific format to enable extract, transform, and load processes, and efficiently query this data. Massively parallel processing. Query language.

Artificial Intelligence 197

Artificial Intelligence Storage Analytics Government 197

ScaleOut Software

APRIL 22, 2020

The Solution: Distributed Caching. The solution to this challenge is to use scalable, memory-based data storage for fast-changing data so that web sites can keep up with exploding workloads. It’s not enough simply to lash together a set of servers hosting a collection of in-memory caches.

Cache 52

Cache Storage Servers Database 52

ScaleOut Software

APRIL 22, 2020

The Solution: Distributed Caching. The solution to this challenge is to use scalable, memory-based data storage for fast-changing data so that web sites can keep up with exploding workloads. It’s not enough simply to lash together a set of servers hosting a collection of in-memory caches.

Cache 52

Cache Storage Servers Database 52

The Netflix TechBlog

MARCH 10, 2023

are stored in secure storage layers. Amsterdam is built on top of three storage layers. Although this indexing strategy worked smoothly for a while, interesting challenges started coming up and we started to notice performance issues over time. When performing a query, we always execute it on the alias.

Strategy 258

Strategy Cache Analytics Storage 258

Scalegrid

JANUARY 5, 2024

Despite initial investment costs, DBMS presents long-term savings and improved efficiency through automated processes, efficient query optimizations, and scalability, contributing to enhanced decision-making and end-user productivity. It provides tools for organizing and retrieving data efficiently.

Efficiency 147

Efficiency Storage Database Scalability 147

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Speed is next; serverless solutions are quick to spin up or down as needed, and there are no delays due to limited storage or resource access. AWS offers four serverless offerings for storage.

Serverless 269

Serverless AWS Lambda Storage 269

HammerDB

APRIL 19, 2023

Predicting application performance is a difficult art, but an important one when choosing the target deployment environment. In this blog, we aim to call out some key considerations when trying to assess MySQL performance for your application. For storage, FIO is generally used.

Performance 54

Performance Benchmarking Cache Storage 54

Scalegrid

DECEMBER 21, 2023

Buckle up as we delve into the world of Redis® monitoring, exploring the most important Redis® metrics, discussing essential tools, and even peering into the future of Redis® performance management. Key Takeaways Redis® monitoring is essential for safeguarding performance, reliability, and security.

Strategy 130

Strategy Monitoring Latency DevOps 130

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to [Systems Performance 2nd Edition], and this was the first time I've given this talk in person! Or even on a plane.

Performance 110

Performance Latency Cache Virtualization 110

Dynatrace

JANUARY 16, 2023

The study analyzes factual Kubernetes production data from thousands of organizations worldwide that are using the Dynatrace Software Intelligence Platform to keep their Kubernetes clusters secure, healthy, and high performing. The report also reveals the leading programming languages practitioners use for application workloads.

Open Source 333

Open Source Java Operating System Programming 333

The Netflix TechBlog

NOVEMBER 15, 2022

Rachel Kelley (AWS), Ranjit Raju (AWS) Rendering is core to the the VFX process VFX studios around the world create amazing imagery for Netflix productions. We look forward to working alongside Netflix to enable access for more creators to streamlined infrastructure and high-performance compute power on the world’s leading cloud.

Cloud 282

Cloud Entertainment AWS Infrastructure 282

Smashing Magazine

JANUARY 11, 2021

Front-End Performance Checklist 2021. Front-End Performance Checklist 2021. This guide has been kindly supported by our friends at LogRocket , a service that combines frontend performance monitoring , session replay, and product analytics to help you build better customer experiences. Web performance is a tricky beast, isn’t it?

Performance 145

Performance Cache Media Metrics 145

Dynatrace

SEPTEMBER 13, 2023

The framework comprises six pillars: Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, and Sustainability. And how can you verify this performance consistently across a multicloud environment that also uses Microsoft Azure and Google Cloud Platform frameworks?

AWS 236

AWS Efficiency Azure Cloud 236

Percona

MAY 1, 2023

In this blog post, we will delve into the world of PostgreSQL performance tuning and establish some basic guidelines for setting database parameters to enhance the performance of your PostgreSQL database, based on the workload. What is PostgreSQL performance tuning? Why is PostgreSQL performance tuning important?

Tuning 52

Tuning Efficiency Database Performance 52

Percona

APRIL 7, 2023

I’ve used a fourth instance to host a PMM server to monitor servers A and B and used the data collected by the PMM agents installed on the database servers to compare performance. To be fair, that is also true with PostgreSQL; it hasn’t been tuned either, and it, too, can also perform much better. Why is that?

Tuning 135

Tuning Cache Servers Benchmarking 135

Dotcom-Montior

MARCH 6, 2022

It assists in identifying where important events happened during the loading process. They can also let the user easily see how good or bad the performance of their website is, showing you exactly what is slowing down your site. When the user clicks on the specific element button, they are welcomed by a performance page, shown below.

Performance 52

Performance Cache Website Speed 52

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19. This is not surprising in hindsight.

Storage 64

Storage Systems Hardware Efficiency 64

The Morning Paper

FEBRUARY 20, 2020

Extending relational query processing with ML inference , Karanasos, CIDR’10. The motivation is not that inference will perform better inside the database, but that the database is the best place to take advantage of enterprise features (transactions, security, auditing, HA, and so on). " Query execution. ."

Processing 72

Processing Hardware Database Azure 72

Percona

DECEMBER 23, 2022

I wrote this post on MyRocks because I believe it is the most interesting new MySQL storage engine to have appeared over the last few years. I decided to use a virtual machine with two CPU cores, four GB of memory, and storage limited to a maximum of 1000 IOPs of 16KB. Once warmed, the performance level never felt under 100 Trx/s.

Storage 55

Storage Cache C++ Virtualization 55

The Netflix TechBlog

MAY 4, 2023

The first phase involves validating functional correctness, scalability, and performance concerns and ensuring the new systems’ resilience before the migration. These include Quality-of-Experience(QoE) measurements at the customer device level, Service-Level-Agreements (SLAs), and business-level Key-Performance-Indicators(KPIs).

Traffic 339

Traffic Latency Tuning Systems 339

Percona

MARCH 28, 2023

It’s to ensure that our data is durable after each write operation and to make it persistent and consistent without compromising the performance. The same data, in the form of pages inside the Wiredtiger cache, are also marked dirty. Although both the processes (involving disk) might look the same, they have different purposes.

Hardware 85

Hardware C++ Storage Cache 85

IO River

NOVEMBER 2, 2023

They need to deliver impeccable performance without breaking the bank.According to recent industry statistics, global streaming has seen an uptick of 30% in the past year, underscoring the importance of efficient CDN architecture strategies. Given its unchanging nature, static content is ideal for caching.

Architecture 52

Architecture Performance Internet Internet 52

Alex Russell

MARCH 6, 2021

Back in 2016, I gave a talk outlining the causes and effects of the terrible performance of web apps built using popular tools on the fastest-growing device segment: low-end to mid-range Android phones. Poor performance has a compound effect on user expectations at an ecosystem level. Live by the link, die by the link.

Performance 124

Performance Network Cache Metrics 124

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. It became clear that real-time query processing and in-stream processing is the immediate need in many practical applications. High performance and mobility. Fault-tolerance.

Big Data 154

Big Data Processing Lambda Database 154

Percona

JULY 25, 2023

When a new node joins the cluster, SST is performed to receive the data from DONOR to the JOINER. Percona XtraBackup performs crash recovery on the files to make a consistent, usable database again. This search tuple (key) is used to find the record to perform the undo operation. JOINER must prepare the backup before using it.

Cache 85

Cache Benchmarking Servers Design 85

Dynatrace

DECEMBER 20, 2021

Replays provide on-demand data about where conversion processes aren’t working. By analyzing sessions of new employees interacting with key tools, teams can provide detailed instructions that will help to streamline the onboarding process and get staff up to speed faster. Are customers losing interest? Enhancing error correction.

Mobile 237

Mobile Website Analytics Cache 237

Dotcom-Montior

MAY 6, 2020

It assists in identifying where important events happened during the loading process. They can also let the user easily see how good or bad the performance of their website is, showing you exactly what is slowing down your site. When the user clicks on the specific element button, they are welcomed by a performance page, shown below.

Performance 53

Performance Cache Website Speed 53

Brendan Gregg

FEBRUARY 28, 2023

At USENIX SREcon22 APAC I gave the opening keynote on the future of computer performance, rounding up the latest developments and making predictions of where I see things heading. This talk originated from my updates to Systems Performance 2nd Edition , and this was the first time I've given this talk in person!

Performance 52

Performance Latency Cache Virtualization 52

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Lambda 98

Lambda Serverless Cache Latency 98