article thumbnail

Migrating Critical Traffic At Scale with No Downtime?—?Part 1

The Netflix TechBlog

Migrating Critical Traffic At Scale with No Downtime — Part 1 Shyam Gala , Javier Fernandez-Ivern , Anup Rokkam Pratap , Devang Shah Hundreds of millions of customers tune into Netflix every day, expecting an uninterrupted and immersive streaming experience. This approach has a handful of benefits.

Traffic 339
article thumbnail

Consistent caching mechanism in Titus Gateway

The Netflix TechBlog

We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe. For example, it is OK to send writes through one instance, and do reads from another one with full data read consistency guarantees.

Cache 224
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Seeing through hardware counters: a journey to threefold performance increase

The Netflix TechBlog

A quick canary test was free of errors and showed lower latency, which is expected given that our standard canary setup routes an equal amount of traffic to both the baseline running on 4xl and the canary on 12xl. We also see much higher L1 cache activity combined with 4x higher count of MACHINE_CLEARS.

Hardware 363
article thumbnail

Migrating Netflix to GraphQL Safely

The Netflix TechBlog

The GraphQL shim enabled client engineers to move quickly onto GraphQL, figure out client-side concerns like cache normalization, experiment with different GraphQL clients, and investigate client performance without being blocked by server-side migrations. The Replay Tester tool samples raw traffic streams from Mantis.

Traffic 353
article thumbnail

Cache and Prizes

Alex Russell

Browsers will cache tools popular among vocal, leading-edge developers. There's plenty of space for caching most popular frameworks. The best available proxy data also suggests that shared caches would have a minimal positive effect on performance. Browsers now understand the classic shared HTTP cache behaviour as a privacy bug.

Cache 82
article thumbnail

WebP Caching has Landed!

KeyCDN

We’re happy to announce that WebP Caching has landed! How Does WebP Caching Work? jpg in the example above) will not change. Below is an example for Nginx that manages the delivery of WebP assets on your origin server. Enable the Feature for your Zones Cache Key WebP can be enabled for all Pull Zones.

Cache 81
article thumbnail

Supporting Diverse ML Systems at Netflix

The Netflix TechBlog

Example use case: Content Knowledge Graph Our knowledge graph of the entertainment world encodes relationships between titles, actors and other attributes of a film or series, supporting all aspects of business at Netflix. For many of our applications, model explainability matters. ETL workflows), as well as downstream (e.g.

Systems 226