The Netflix TechBlog

MARCH 7, 2024

Berg , Romain Cledat , Kayla Seeley , Shashank Srikanth , Chaoying Wang , Darin Yu Netflix uses data science and machine learning across all facets of the company, powering a wide range of business applications from our internal infrastructure and content demand modeling to media understanding.

Systems 226

Systems Media Cache Open Source 226

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. This guide provides an overview of what high availability means, the components involved, how to measure high availability, and how to achieve it. More in the following sub-section.)

Availability 105

Availability Database Open Source Hardware 105

Percona

APRIL 17, 2023

We’ll also go over some best practices for MongoDB security as well as MongoDB data modeling. Note that the intent of tuning the settings is not exclusively about improving performance but also enhancing the high availability and resilience of the MongoDB database. Spoiler alert: This post focuses on MongoDB 3.6.X

Best Practices 52

Best Practices Design Tuning Database 52

Scalegrid

JANUARY 5, 2024

Enhanced data security, better data integrity, and efficient access to information. This article cuts through the complexity to showcase the tangible benefits of DBMS, equipping you with the knowledge to make informed decisions about your data management strategies. What are the key advantages of DBMS?

Efficiency 147

Efficiency Storage Database Scalability 147

Smashing Magazine

MAY 9, 2022

Performance Game Changer: Browser Back/Forward Cache. Performance Game Changer: Browser Back/Forward Cache. With that caveat out of the way, let’s get to the guts of the article: What is the Back/Forward Cache and why does it matter so much? Didn’t The HTTP Cache Do All That Anyway? Barry Pollard.

Cache 91

Cache Games Performance Website 91

The Netflix TechBlog

NOVEMBER 9, 2022

At Netflix, we periodically reevaluate our workloads to optimize utilization of available capacity. We also see much higher L1 cache activity combined with 4x higher count of MACHINE_CLEARS. a usage pattern occurring when 2 cores reading from / writing to unrelated variables that happen to share the same L1 cache line.

Hardware 363

Hardware Cache Performance Latency 363

Scalegrid

JANUARY 25, 2024

Effective management of memory stores with policies like LRU/LFU proactive monitoring of the replication process and advanced metrics such as cache hit ratio and persistence indicators are crucial for ensuring data integrity and optimizing Redis’s performance. offers the Software Watchdog specifically designed for this purpose.

Metrics 130

Metrics Monitoring Latency Cache 130

Dynatrace

DECEMBER 21, 2023

Growing awareness and increasing regulatory scrutiny have propelled carbon emissions data into the public consciousness. Evaluating these on three levels—data center, host, and application architecture (plus code)—is helpful. Level 1: Data centers This is the starting point for most organizations. A PUE of 1.0

Cloud 214

Cloud Energy Best Practices Cache 214

The Morning Paper

JUNE 25, 2019

Designing far memory data structures: think outside the box Aguilera et al., Last time out we looked at some of the trade-offs between RInKs and LInKs , and the advantages of local in-memory data structures. For many data center applications this looks to me like it could be a compelling future choice. HotOS’19.

Design 80

Design Cache Hardware Scalability 80

cdemi

MAY 8, 2016

Applications that rely heavily on a data-store usually can benefit greatly from using the Cache-Aside Pattern. If used correctly, this pattern can improve performance and help maintain consistency between the cache and the underlying data store. This post is part of a Design Patterns series. Reading Data.

Cache 54

Cache Design C++ Processing 54

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. Designed with High Availability in mind. This is crucial for repairs downstream when data has been lost or corrupted.

Database 212

Database Traffic Transportation Open Source 212

The Netflix TechBlog

DECEMBER 17, 2019

Andreas Andreakis , Ioannis Papapanagiotou Overview Change-Data-Capture (CDC) allows capturing committed changes from a database in real-time and propagating those changes to downstream consumers [1][2]. Designed with High Availability in mind. This is crucial for repairs downstream when data has been lost or corrupted.

Database 197

Database Traffic Transportation Open Source 197

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

All Things Distributed

SEPTEMBER 3, 2013

Choosing your database architecture may be the most critical decision you’ll make and has a disproportionate impact on the performance, scalability, and availability of your app. Get it right and your application will seamlessly scale from hundreds to tens of millions of users without difficulty, while remaining performant and available.

Cache 129

Cache Cloud Performance Retail 129

Percona

APRIL 6, 2023

PostgreSQL is a popular open source relational database management system many organizations use to store and manage their data. Query caching Pgpool-II can cache frequently used queries in memory, reducing the load on your PostgreSQL servers and improving response times. Pgpool-II This is where the pgpool-II comes in.

Cache 111

Cache Open Source Benchmarking Database 111

Dynatrace

MARCH 22, 2023

As a result, web app attacks are the fastest-growing attack vector according to a recent data breach investigations report. Cryptographic failures Cryptographic failures are when data is transmitted in plain text, uses outdated or insecure cryptographic algorithms, or is protected by default or weak cryptographic keys.

Open Source 203

Open Source Artificial Intelligence Internet Internet 203

Dynatrace

APRIL 10, 2023

And according to recent data from Enterprise Strategy Group, 59% of survey respondents indicated spending on public cloud applications would increase in 2023. We also couldn’t compromise on performance and availability.” “We can analyze the data from those services in context.”

Cloud 176

Cloud Ecommerce Performance Retail 176

Dynatrace

OCTOBER 7, 2021

Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Amazon EventBridge: EventBridge to bridges the data gap between your applications and other services, such as Lambda or specific SaaS apps. Data Store.

Serverless 286

Serverless AWS Lambda Storage 286

Percona

JULY 25, 2023

When a new node joins the cluster, SST is performed to receive the data from DONOR to the JOINER. JOINER uses PXB to stream the data directory from DONOR. Percona XtraBackup copies the InnoDB data files. Percona XtraBackup copies the InnoDB data files. ibd2sdi data/test/t1.ibd CREATE TABLE test.t1(a ibd > t1.sdi

Cache 84

Cache Benchmarking Servers Design 84

High Scalability

FEBRUARY 17, 2021

This is guest post by Sachin Sinha who is passionate about data, analytics and machine learning at scale. Load stage is to load the data and then run stage we run the test. Load is consistent for all dbs for all tests as expected as this phase is to load the data. Author & founder of BangDB. Workload C: Read only.

Benchmarking 308

Benchmarking Latency C++ Database 308

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 251

Cache Latency Airlines Logistics 251

Dynatrace

SEPTEMBER 13, 2023

This is a set of best practices and guidelines that help you design and operate reliable, secure, efficient, cost-effective, and sustainable systems in the cloud. These workflows also utilize Davis® , the Dynatrace causal AI engine, and all your observability and security data across all platforms, in context, at scale, and in real-time.

AWS 252

AWS Efficiency Azure Cloud 252

IO River

NOVEMBER 2, 2023

CDNs cache content on edge servers distributed globally, reducing the distance between users and the content they want.‍CDNs use load-balancing techniques to distribute incoming traffic across multiple servers called Points of Presence (PoPs) which distribute content closer to end-users and improve overall performance.

Architecture 52

Architecture Cache Performance Latency 52

The Netflix TechBlog

SEPTEMBER 8, 2020

This allowed Android engineers to have much more control and observability over how we get our data. Background The Netflix Android app uses the falcor data model and query protocol. For example, the artwork service is separate from the video metadata service, but we need the data from both in the detail key.

Latency 233

Latency Cache Java Traffic 233

Smashing Magazine

JUNE 26, 2019

What Web Designers Can Do To Speed Up Mobile Websites. What Web Designers Can Do To Speed Up Mobile Websites. I recently wrote a blog post for a web designer client about page speed and why it matters. However, their focus has always been on making a great-looking and effective design. Suzanne Scacca. Minification.

Website 110

Website Speed Mobile Design 110

Smashing Magazine

JUNE 26, 2020

Inspired Design Decisions With Giovanni Pintori: Publicity Becomes An Art Form. Inspired Design Decisions With Giovanni Pintori: Publicity Becomes An Art Form. With one or two occasional exceptions, I’ve spent the past twenty-two years designing for countless clients. I know many designers who work in-house.

Design 95

Design Media C++ Energy 95

Percona

SEPTEMBER 1, 2023

MySQL triggers are a powerful tool for database administrators and developers, enabling them to automate tasks, enforce data consistency, and respond to events within the database seamlessly. The significance of triggers lies in their ability to enforce data integrity and automate various database-related tasks.

Cache 59

Cache Database Games Healthcare 59

The Netflix TechBlog

OCTOBER 16, 2019

Another example of a dataset that needs to be disseminated is the result of a machine-learning model: the results of these models may be used by several teams, but the ML teams behind the model aren’t necessarily interested in maintaining high-availability services in the critical path. there is no dependency on previous versions of data.

Cache 187

Cache Architecture Metrics Java 187

IO River

NOVEMBER 2, 2023

CDNs cache content on edge servers distributed globally, reducing the distance between users and the content they want.‍CDNs CDN architecture also focuses on caching, load balancing, routing, and optimizing content delivery, which can be measured by: cache offloading and round-trip time (RTT).‍RTT

Architecture 52

Architecture Cache Performance Latency 52

The Morning Paper

SEPTEMBER 10, 2019

Procella: unifying serving and analytical data at YouTube Chattopadhyay et al., Anchored in the primary use case of supporting Google’s YouTube business, what we’re looking at here could well be the future of data processing at Google. Because they had too many data processing systems! ;). VLDB’19. are divided.

Analytics 75

Analytics Latency Cache Google 75

Dynatrace

JULY 16, 2020

I wanted to leverage Dynatrace’s Environment APIs, for example to export timeseries data, get problem stats, or change configuration settings, like enforcing a certain data privacy setting. I wanted a rather lightweight design that is yet versatile. So, I came up with four services that will be needed: ?

Cache 235

Cache Serverless Efficiency Tuning 235

ScaleOut Software

MAY 15, 2014

We have spent a great deal of time at ScaleOut Software re-architecting our in-memory data grid (IMDG)’s code base to make best use of many cores and large memory. During load-balancing, the client gets the following exception when accessing the cache: ErrorCode<ERRCA0017>:SubStatus<ES0006>:There is a temporary failure.

Cache 40

Cache Servers Network Design 40

MachMetrics

SEPTEMBER 1, 2020

Responsive design is an absolute necessity in today’s web. Unfortunately, many themes and frameworks achieve responsive design by using hidden images on mobile devices or tablets. With this method, everyone is being served the most performant images available to them. Making the image a div with a background.

Design 57

Design Media Mobile Website 57

John McCalpin

APRIL 25, 2023

For most high-end processors these values have remained in the range of 75% to 85% of the peak DRAM bandwidth of the system over the past 15-20 years — an amazing accomplishment given the increase in core count (with its associated cache coherence issues), number of DRAM channels, and ever-increasing pipelining of the DRAMs themselves.

Benchmarking 97

Benchmarking Cache Latency Tuning 97

Dynatrace

APRIL 21, 2022

But managing these three data types at a scale becomes unsustainable for even the most experienced teams. The Azure Well-Architected Framework is a set of guiding tenets organizations can use to evaluate architecture and implement designs that will scale over time. What is the Azure Well-Architected Framework? Operational excellence.

Azure 193

Azure Monitoring Virtualization Metrics 193

Percona

MARCH 28, 2023

It’s to ensure that our data is durable after each write operation and to make it persistent and consistent without compromising the performance. In terms of MongoDB, it achieves WAL and data durability using a combination of both Journaling and Checkpoints. Starting with the basics, why is WAL needed in the first place?

Hardware 85

Hardware C++ Storage Cache 85

Brendan Gregg

MARCH 16, 2024

It fails because of a compiler optimization where the frame pointer register is used to store data instead of the frame pointer, but it's just a number so the profiler is unaware this happened and tries to match that address to a function symbol and fails (it is therefore an unknown symbol). You usually get an extra junk frame.

Java 145

Java Cache Google Hardware 145