article thumbnail

Rebuilding Netflix Video Processing Pipeline with Microservices

The Netflix TechBlog

This architecture shift greatly reduced the processing latency and increased system resiliency. We expanded pipeline support to serve our studio/content-development use cases, which had different latency and resiliency requirements as compared to the traditional streaming use case. divide the input video into small chunks 2.

article thumbnail

The Netflix Cosmos Platform

The Netflix TechBlog

It supports both high throughput services that consume hundreds of thousands of CPUs at a time, and latency-sensitive workloads where humans are waiting for the results of a computation. The subsystems all communicate with each other asynchronously via Timestone, a high-scale, low-latency priority queuing system. Warm capacity.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Self-Host Your Static Assets

CSS Wizardry

One of the quickest wins—and one of the first things I recommend my clients do—to make websites faster can at first seem counter-intuitive: you should self-host all of your static assets, forgoing others’ CDNs/infrastructure. On a slower, higher-latency connection, the story is much, mush worse. Risk: Service Shutdowns. to just 3.6s.

Cache 274
article thumbnail

Stuff The Internet Says On Scalability For December 21st, 2018

High Scalability

@kellabyte : “Open source” infrastructure companies are a giant s**t show right now. Tim Bray : How to talk about [Serverless Latency] · To start with, don’t just say “I need 120ms. Whether it’s database or message queues it’s a really weird combo of licenses and features for hostage.

Internet 137
article thumbnail

Stuff The Internet Says On Scalability For July 20th, 2018

High Scalability

A typical example of modern "microservices-inspired" Java application would function along these lines: Netflix : We observed during experimentation that RAM random read latencies were rarely higher than 1 microsecond whereas typical SSD random read speeds are between 100–500 microseconds.

Internet 121
article thumbnail

Ciao Milano! – An AWS Region is coming to Italy!

All Things Distributed

Currently we have 57 Availability Zones across 19 technology infrastructure Regions. Lamborghini, the world-famous manufacturer of elite, luxury sports cars based in Italy, has been using AWS to reduce the cost of their infrastructure by 50 percent, while also achieving better performance and scalability. million unique visits.

AWS 167
article thumbnail

Expanding the Cloud – An AWS Region is coming to Hong Kong

All Things Distributed

The new AWS Asia Pacific (Hong Kong) Region will have three Availability Zones and be ready for customers for use in 2018. This enables customers to serve content to their end users with low latency, giving them the best application experience. Over the past decade, we have seen tremendous growth at AWS.

AWS 146