The Netflix TechBlog

JUNE 13, 2023

Migrating Critical Traffic At Scale with No Downtime — Part 2 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Picture yourself enthralled by the latest episode of your beloved Netflix series, delighting in an uninterrupted, high-definition streaming experience. This is where large-scale system migrations come into play.

Traffic 279

Traffic Metrics Systems Strategy 279

IO River

NOVEMBER 2, 2023

If price is your top priority, you'll need to decide how much you're willing to sacrifice in terms of reliability and performance.What are your traffic patterns like? If your traffic is mostly static, you may be able to meet all your needs with a less expensive CDN that provides content distribution services.

Infrastructure 52

Infrastructure Traffic Cache Strategy 52

IO River

NOVEMBER 2, 2023

If price is your top priority, you'll need to decide how much you're willing to sacrifice in terms of reliability and performance.What are your traffic patterns like? If your traffic is mostly static, you may be able to meet all your needs with a less expensive CDN that provides content distribution services.

Infrastructure 52

Infrastructure Traffic Cache Strategy 52

Smashing Magazine

JUNE 25, 2020

We’ll also discuss the costs and benefits of CDNs and dedicated file storage solutions. Also called “static assets,” these files include CSS and JavaScript, both written by the application developer and third-party libraries, as well as PDFs, software installers, images, music, videos, and icons. Media Files.

Media 69

Media Cache Storage AWS 69

The Morning Paper

OCTOBER 4, 2020

Three different 5G phones are used, including a ZTE Axon10 Pro with powerful communication (SDX 50 5G modem) and compute (Qualcomm Snapdragon TM855) capabilities together with 256GB of storage. Does 5G improve the end-user experience for applications (web browsing, and 4K+ video streaming)? What about UHD video?

Energy 130

Energy Latency Performance Network 130

All Things Distributed

MARCH 11, 2015

This allows local councils to keep certain streets well lit, to accommodate high foot traffic, bring on lighting during adverse weather, when ambient light dims to a dangerous level, or even turn lighting down, for example in an industrial estate, where there are no people. Cloud enables video analytics.

Analytics 135

Analytics Cloud Healthcare Retail 135

SQL Performance

NOVEMBER 18, 2019

IT professionals are familiar with scoping the size of VMs with regards to vCPU, memory, and storage capacity. Compute optimized – High CPU-to-memory ration, medium traffic web servers and application servers. Storage optimized – High disk throughput and IO. GPU – Heavy graphic rendering and video editing. Generation.

Azure 76

Azure Benchmarking Storage Virtualization 76

The Netflix TechBlog

NOVEMBER 2, 2021

Moorthy and Zhi Li Introduction Measuring video quality at scale is an essential component of the Netflix streaming pipeline. Perceptual quality measurements are used to drive video encoding optimizations , perform video codec comparisons , carry out A/B testing and optimize streaming QoE decisions to mention a few.

Media 171

Media Innovation Metrics Latency 171

Dotcom-Montior

MAY 12, 2020

Websites are now more than just the storage and retrieval of information to present content to users. Monitoring of the network for the applications using the network, traffic, and bandwidth allocations can improve the network latency. It’s very common for a website to have an increase in traffic after a marketing campaign.

Monitoring 63

Monitoring Entertainment Hardware Latency 63

Brendan Gregg

DECEMBER 31, 2017

Fortunately, it was videoed for those who missed it. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work. Storage I/O. Casey Rosenthal (traffic and chaos) Models of Availability.

Tuning 61

Tuning AWS Best Practices Network 61

Brendan Gregg

DECEMBER 30, 2017

Fortunately, it was videoed for those who missed it. A video of the talk is on youtube : The slides are on slideshare : I love this talk as I get to share more about what the Performance and Operating Systems team at Netflix does, rather than just my work. Storage I/O. Casey Rosenthal (traffic and chaos) Models of Availability.

Tuning 52

Tuning AWS Best Practices Network 52

Tech News Gather

JUNE 16, 2023

Choose a robust technology stack that can handle high traffic and accommodate future growth. Database management: Choose a database management system that can handle large amounts of data and ensure efficient retrieval and storage. Utilize features like load balancing and auto-scaling to handle increasing user traffic efficiently.

Social Media 52

Social Media Tuning Strategy Media 52

Smashing Magazine

JANUARY 11, 2021

Assets Optimizations Brotli, AVIF, WebP, responsive images, AV1, adaptive media loding, video compression, web fonts, Google fonts. CrUX generates an overview of performance distributions over time, with traffic collected from Google Chrome users. You can then mimic the 90th percentile’s experience for testing. Large preview ).

Performance 145

Performance Cache Media Metrics 145

O'Reilly

DECEMBER 2, 2019

I don’t need more bandwidth for video conferences or movies, but I would like to be able to download operating system updates and other large items in seconds rather than minutes. What would the world look like if all of our storage was in the cloud, and access to that storage was so fast we didn’t care?

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

Percona

APRIL 17, 2023

Since MongoDB usually works with a replica set, it is possible to increase this parameter to get better performance: # edit /etc/mongod.conf storage: journal: enabled: true commitIntervalMs: 300 WiredTiger cache For dedicated servers, it is possible to increase the WiredTiger(WT) cache. By default, it uses 50% of the memory + 1 GB.

Best Practices 52

Best Practices Design Tuning Database 52

The Netflix TechBlog

SEPTEMBER 2, 2020

Edgar captures 100% of interesting traces , as opposed to sampling a small fixed percentage of traffic. This difference has substantial technological implications, from the classification of what’s interesting to transport to cost-effective storage (keep an eye out for later Netflix Tech Blog posts addressing these topics).

Latency 296

Latency Transportation Engineering Traffic 296

Smashing Magazine

JANUARY 6, 2020

To get a good first impression of how your competitors perform, you can use Chrome UX Report ( CrUX , a ready-made RUM data set, video introduction by Ilya Grigorik and detailed guide by Rick Viscomi) or Treo Sites , a RUM monitoring tool that is powered by Chrome UX Report. Are videos properly optimized? Large preview ).

Performance 145

Performance Cache Network Metrics 145

Smashing Magazine

JANUARY 7, 2019

To get a good first impression of how your competitors perform, you can use Chrome UX Report ( CrUX , a ready-made RUM data set, video introduction by Ilya Grigorik), Speed Scorecard (also provides a revenue impact estimator), Real User Experience Test Comparison or SiteSpeed CI (based on synthetic testing). Are videos properly optimized?

Performance 103

Performance Cache Metrics Network 103

The Netflix TechBlog

MAY 14, 2021

Prodicle Distribution Our service is required to be elastic and handle bursty traffic. The watermarking functionality, at the start, was a simple offering with various Google Drive integrations for storage and links. We had to traverse multiple codebases, and observability systems to debug errors and inefficiencies in the system.

Traffic 160

Traffic Latency Java Google 160

The Netflix TechBlog

MARCH 10, 2023

By Burak Bacioglu , Meenakshi Jindal Asset Management at Netflix At Netflix, all of our digital media assets (images, videos, text, etc.) are stored in secure storage layers. Amsterdam is built on top of three storage layers. We also utilize Kafka to process these assets asynchronously without impacting our real time traffic.

Strategy 258

Strategy Cache Analytics Storage 258

O'Reilly

SEPTEMBER 19, 2023

It progressed from “raw compute and storage” to “reimplementing key services in push-button fashion” to “becoming the backbone of AI work”—all under the umbrella of “renting time and storage on someone else’s computers.” ” (It will be easier to fit in the overhead storage.)

Hardware 99

Hardware Storage Big Data Blockchain 99

Brendan Gregg

SEPTEMBER 5, 2017

. ## Observability Here's the big picture of performance observability tools on Linux, from my [Linux performance] page, where I also have diagrams for other tool types, as well as videos and slides of prior Linux performance talks: I also have a USE Method: Linux Performance Checklist , as a different way to navigate and apply the tools.

Virtualization 76

Virtualization AWS Engineering Hardware 76

All Things Distributed

OCTOBER 2, 2017

VPC Endpoints give you the ability to control whether network traffic between your application and DynamoDB traverses the public Internet or stays within your virtual private cloud. Performant – DynamoDB consistently delivers single-digit millisecond latencies even as your traffic volume increases.

Internet 128

Internet Internet AWS Performance 128

All Things Distributed

MARCH 11, 2016

This becomes an even more important lesson at scale: for example, as S3 processes trillions and trillions of storage transactions, anything that has even the slightest probability of error will become realistic. If customers have many tiny files, then storage and bandwidth don’t amount to much even if they are making millions of requests.

AWS 144

AWS Hardware Retail Virtualization 144

High Scalability

MARCH 15, 2019

trillion : new record for calculating digits of pi (121 days); 112Gbps : Intel's SerDes; 100M : image and video dataset; 1.5 were using Google Cloud Storage, but given too many issues big and small over the year, we’ll be migrating to AWS S3 for storage going forward. They'll learn a lot and love you even more.

Internet 34

Internet Internet Scalability IoT 34