article thumbnail

Consistent caching mechanism in Titus Gateway

The Netflix TechBlog

We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe. For example, it is OK to send writes through one instance, and do reads from another one with full data read consistency guarantees.

Cache 224
article thumbnail

Supporting Diverse ML Systems at Netflix

The Netflix TechBlog

Example use case: Content Knowledge Graph Our knowledge graph of the entertainment world encodes relationships between titles, actors and other attributes of a film or series, supporting all aspects of business at Netflix. Occasionally, these use cases involve terabytes of data, so we have to pay attention to performance.

Systems 226
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Improved Alerting with Atlas Streaming Eval

The Netflix TechBlog

While we were able to put out the immediate fire by disabling the newly created alerts, this incident raised some critical concerns around the scalability of our alerting system. It became clear to us that we needed to solve the scalability problem with a fundamentally different approach. OK, Results?

Storage 288
article thumbnail

Sustainable IT: Optimize your hybrid-cloud carbon footprint

Dynatrace

And while these examples were resolved by just asking a few questions, in many cases, the answers are more elusive, requiring real-time and historical drill-downs into the processes and dependencies specific to each host. A few examples: Reduce roundtrips between services (for example, the N+1 query pattern).

Cloud 218
article thumbnail

ABAC on SpiceDB: Enabling Netflix’s Complex Identity Types

The Netflix TechBlog

The Beginning of SpiceDB Caveats The SpiceDB community had already explored integrating SpiceDB with Open Policy Agent (OPA) and concluded it strayed too far from Zanzibar’s core promise of global horizontal scalability with strong consistency. As you’d suspect, this would jeopardize one of the pillars of the system: its ability to scale.

Cache 249
article thumbnail

Designing Instagram

High Scalability

We have chosen this NoSQL based solution over relational databases as it provides the scalability to have hierarchies which go beyond two levels and extensibility due to the schema-less behavior of NoSQL data storage. We will use a cache having an LRU based eviction policy for caching user feeds of active users. Optimization.

Design 334
article thumbnail

Use Distributed Caching to Accelerate Online Web Sites

ScaleOut Software

The Solution: Distributed Caching. The solution to this challenge is to use scalable, memory-based data storage for fast-changing data so that web sites can keep up with exploding workloads. It’s not enough simply to lash together a set of servers hosting a collection of in-memory caches.

Cache 52