The Netflix TechBlog

MARCH 4, 2024

We have deployed Auto Remediation in production for handling memory configuration errors and unclassified errors of Spark jobs and observed its efficiency and effectiveness (e.g., For efficient error handling, Netflix developed an error classification service, called Pensive, which leverages a rule-based classifier for error classification.

Tuning 210

Tuning Efficiency Big Data Engineering 210

Dynatrace

SEPTEMBER 13, 2023

This is a set of best practices and guidelines that help you design and operate reliable, secure, efficient, cost-effective, and sustainable systems in the cloud. The framework comprises six pillars: Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, and Sustainability.

AWS 252

AWS Efficiency Azure Cloud 252

The Netflix TechBlog

MARCH 6, 2019

—?Mounting object storage in Netflix’s media processing platform By Barak Alon (on behalf of Netflix’s Media Cloud Engineering team) MezzFS (short for “Mezzanine File System”) is a tool we’ve developed at Netflix that mounts cloud objects as local files via FUSE. Encoding is not a one-time process?—?large We have one file?—?the

Media 214

Media Storage Processing Cache 214

Dynatrace

JANUARY 31, 2024

The RAG process begins by summarizing and converting user prompts into queries that are sent to a search platform that uses semantic similarities to find relevant data in vector databases, semantic caches, or other online data sources. RAG augments user prompts with relevant data retrieved from outside the LLM.

Cache 209

Cache Azure Infrastructure Monitoring 209

Dynatrace

APRIL 7, 2023

Dynatrace is a launch partner in support of AWS Lambda Response Streaming , a new capability enabling customers to improve the efficiency and performance of their Lambda functions. Customers can use AWS Lambda Response Streaming to improve performance for latency-sensitive applications and return larger payload sizes.

Lambda 221

Lambda AWS Serverless Latency 221

The Netflix TechBlog

NOVEMBER 3, 2023

Democratizing Stream Processing @ Netflix By Guil Pires , Mark Cho , Mingliang Liu , Sujay Jain Data powers much of what we do at Netflix. On the Data Platform team, we build the infrastructure used across the company to process data at scale. In our last blog post, we introduced “Data Mesh” — A Data Movement and Processing Platform.

Processing 265

Processing Engineering Infrastructure Latency 265

The Netflix TechBlog

MARCH 7, 2024

Without these integrations, projects would be stuck at the prototyping stage, or they would have to be maintained as outliers outside the systems maintained by our engineering teams, incurring unsustainable operational overhead. Importantly, all the use cases were engineered by practitioners themselves.

Systems 226

Systems Media Cache Open Source 226

Dynatrace

JUNE 1, 2023

Response time Response time refers to the total time it takes for a system to process a request or complete an operation. This ensures that customers can quickly navigate through product listings, add items to their cart, and complete the checkout process without experiencing noticeable delays. or above for the checkout process.

Latency 182

Latency Website Traffic Virtualization 182

Scalegrid

DECEMBER 21, 2023

Identifying key Redis® metrics such as latency, CPU usage, and memory metrics is crucial for effective Redis monitoring. To monitor Redis® instances effectively, collect Redis metrics focusing on cache hit ratio, memory allocated, and latency threshold.

Strategy 130

Strategy Monitoring Latency DevOps 130

Dynatrace

JUNE 1, 2023

Response time Response time refers to the total time it takes for a system to process a request or complete an operation. This ensures that customers can quickly navigate through product listings, add items to their cart, and complete the checkout process without experiencing noticeable delays. or above for the checkout process.

Traffic 173

Traffic Latency Website Virtualization 173

The Netflix TechBlog

MARCH 1, 2021

It supports both high throughput services that consume hundreds of thousands of CPUs at a time, and latency-sensitive workloads where humans are waiting for the results of a computation. The subsystems all communicate with each other asynchronously via Timestone, a high-scale, low-latency priority queuing system.

Serverless 228

Serverless Media Latency Social Media 228

The Netflix TechBlog

NOVEMBER 17, 2022

A distinct, NN-based, video processing block can evolve independently, be used beyond video downscaling and be combined with different codecs. While conventional video codecs remain prevalent, NN-based video encoding tools are flourishing and closing the performance gap in terms of compression efficiency.

Network 292

Network Media Innovation Efficiency 292

The Netflix TechBlog

SEPTEMBER 24, 2021

By Xiaomei Liu , Rosanna Lee , Cyril Concolato Introduction Behind the scenes of the beloved Netflix streaming service and content, there are many technology innovations in media processing. Packaging has always been an important step in media processing. Uploading and downloading data always come with a penalty, namely latency.

Cloud 237

Cloud Media Storage Cache 237

High Scalability

FEBRUARY 19, 2021

This means a system that is not merely available but is also engineered with extensive redundant measures to continue to work as its users expect. reliability situations, where continuity of service is essential, with redundant elements continuously in-service, such as with airplane engines. This ensures reliability.

Engineering 215

Engineering Systems Scalability Availability 215

The Netflix TechBlog

OCTOBER 27, 2020

Data scientists and engineers collect this data from our subscribers and videos, and implement data analytics models to discover customer behaviour with the goal of maximizing user joy. The processed data is typically stored as data warehouse tables in AWS S3. It leverages Netflix Scheduler for scheduling the Bulldozer Jobs.

Latency 243

Latency Storage Big Data Tuning 243

Dynatrace

JULY 24, 2023

In the world of DevOps and SRE, DevOps automation answers the undeniable need for efficiency and scalability. This evolution in automation, referred to as answer-driven automation, empowers teams to address complex issues in real time, optimize workflows, and enhance overall operational efficiency.

DevOps 225

DevOps Traffic Efficiency Servers 225

Scalegrid

MARCH 28, 2024

As Redis stores data, it supports extensive data key and string lengths, up to 512 MB, while offering complex data structures like: lists sets sorted sets hashes bitmaps These features make Redis much more than a basic caching engine; it is a versatile tool capable of supporting diverse data models.

Cache 130

Cache Storage Scalability Architecture 130

Dynatrace

JULY 18, 2023

As software development grows more complex, managing components using an automated onboarding process becomes increasingly important. However, scaling up software development requires more tools along the software product lifecycle, which must be configured promptly and efficiently. The screenshot below displays such a configuration.

Best Practices 195

Best Practices Code Infrastructure Latency 195

Dynatrace

JANUARY 18, 2023

However, getting reliable answers from observability data so teams can automate more processes to ensure speed, quality, and reliability can be challenging. Site reliability engineering (SRE) is a software operations methodology that enables organizations to create highly reliable and scalable applications. What is DevOps?

DevOps 203

DevOps Best Practices Innovation Strategy 203

Scalegrid

MARCH 14, 2024

Defining Hybrid Cloud Strategy The decision-making process about where to situate data and applications is vital to any hybrid cloud solution. The public cloud’s ability to scale efficiently enables ‘cloudbursting’ when demand spikes without requiring businesses to overprovision their own infrastructures.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

The Netflix TechBlog

JUNE 13, 2023

Replay traffic testing gives us the initial foundation of validation, but as our migration process unfolds, we are met with the need for a carefully controlled migration process. A process that doesn’t just minimize risk, but also facilitates a continuous evaluation of the rollout’s impact.

Traffic 279

Traffic Metrics Systems Strategy 279

The Netflix TechBlog

SEPTEMBER 2, 2020

Edgar helps Netflix teams troubleshoot distributed systems efficiently with the help of a summarized presentation of request tracing, logs, analysis, and metadata. For engineers, instead of whodunit, the question is often “what failed and why?” That alone might give an engineer the knowledge she needs to reproduce the issue.

Latency 296

Latency Transportation Engineering Traffic 296

The Netflix TechBlog

DECEMBER 21, 2020

There are several benefits of such optimizations like saving on storage, faster query time, cheaper downstream processing, and an increase in developer productivity by removing additional ETLs written only for query performance improvement. Then deep dive into the merging use case of AutoOptimize and share some results and benefits.

Storage 203

Storage Latency Efficiency Data Engineering 203

The Netflix TechBlog

OCTOBER 19, 2020

a Netflix member via Twitter This is an example of a question our on-call engineers need to answer to help resolve a member issue?—?which The process started with manual pull of member account information that was part of the session. We needed to increase engineering productivity via distributed request tracing.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. It became clear that real-time query processing and in-stream processing is the immediate need in many practical applications. Strict fault-tolerance is a principal requirement for the engine.

Big Data 154

Big Data Processing Lambda Database 154

Scalegrid

JANUARY 12, 2024

This article analyzes cloud workloads, delving into their forms, functions, and how they influence the cost and efficiency of your cloud infrastructure. In the realm of cloud-based business operations, there is an increasing dependence on complex information processing patterns.

Cloud 130

Cloud Virtualization Storage Efficiency 130

Dynatrace

FEBRUARY 24, 2021

DevOps is focused on optimizing software development and delivery, and SRE is focused on operations processes. DevOps is not a specific process, but rather a general collection of flexible software creation and delivery practices that looks to close the gap between software development and IT operations. Reduced latency.

DevOps 191

DevOps Software Engineering Speed Google 191

Dynatrace

APRIL 5, 2021

The 2014 launch of AWS Lambda marked a milestone in how organizations use cloud services to deliver their applications more efficiently, by running functions at the edge of the cloud without the cost and operational overhead of on-premises servers. Real-time file processing, for quickly indexing files, processing logs, and validating content.

Lambda 184

Lambda AWS Serverless Hardware 184

Dynatrace

DECEMBER 15, 2022

This transition to public, private, and hybrid cloud is driving organizations to automate and virtualize IT operations to lower costs and optimize cloud processes and systems. This includes response time, accuracy, speed, throughput, uptime, CPU utilization, and latency. So, what is ITOps? What is ITOps? Performance.

Artificial Intelligence 208

Artificial Intelligence DevOps Hardware Virtualization 208

Dynatrace

MAY 5, 2021

As more organizations respond to the pressure to release better software faster, there is an increasing need to build quality gates into every stage of BizDevOps processes , from early development to deployment. Automating quality gates creates reliable checks and balances and speeds up the process by avoiding manual intervention.

Benchmarking 188

Benchmarking Latency Speed Software 188

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. Its goal is to assign running processes to time slices of the CPU in a “fair” way. So why mess with it?

Cache 251

Cache Latency Airlines Logistics 251

Percona

MARCH 29, 2023

As the amount of data grows, the need for efficient data compression becomes increasingly important to save storage space, reduce I/O overhead, and improve query performance. Data compression MongoDB offers various block compression methods used by the WiredTiger storage engine, like snappy, zlib, and zstd. I am using PSMDB 6.0.4

Storage 105

Storage Network Open Source Latency 105

The Netflix TechBlog

JULY 12, 2019

By Drew Koszewnik This is the story about how the Content Setup Engineering team used Hollow, a Netflix OSS technology, to re-architect and simplify an essential component in our content pipeline?—?delivering delivering a large amount of business value in the process. Clearly, a change in direction was necessary.

Cache 183

Cache Architecture Latency Engineering 183

The Netflix TechBlog

SEPTEMBER 3, 2021

When we process a request it is often beneficial to know which fields the caller is interested in and which ones they ignore. Remote calls are never free; they impose extra latency, increase probability of an error, and consume network bandwidth. The solution we use within the Netflix Studio Engineering is protobuf FieldMask.

Design 245

Design Java Efficiency Code 245

The Morning Paper

NOVEMBER 10, 2019

You need a lot of software engineers and the willingness to rewrite a lot of software to entertain that idea. Here are the bombshell paragraphs: Our datacenter applications seek ever more CPU-efficient and lower-latency communication, which Pony Express delivers. Upgrades are performed incrementally, one engine at a time.

Network 92

Network Transportation Latency Entertainment 92

The Netflix TechBlog

SEPTEMBER 8, 2020

This allowed Android engineers to have much more control and observability over how we get our data. For each route we migrated, we wanted to make sure we were not introducing any regressions: either in the form of missing (or worse, wrong) data, or by increasing the latency of each endpoint.

Latency 233

Latency Cache Java Traffic 233

Percona

NOVEMBER 2, 2023

Upgrading to the newest release of MongoDB is the key to unlocking its full potential, but it’s not as simple as clicking a button; it requires meticulous planning, precise execution, and a deep understanding of the upgrade process. x: Live resharding of databases for uninterrupted sharded key changes.

Best Practices 84

Best Practices Hardware Tuning Scalability 84