article thumbnail

Consistent caching mechanism in Titus Gateway

The Netflix TechBlog

We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe. The cache is kept in sync with the current leader process. How do I know that my cache is up to date? of the data.

Cache 224
article thumbnail

Designing Instagram

High Scalability

FUN FACT : In this talk , Dikang Gu, a software engineer at Instagram core infra team has mentioned about how they use Cassandra to serve critical usecases, high scalability requirements, and some pain points. We will use a cache having an LRU based eviction policy for caching user feeds of active users. Optimization.

Design 334
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Static Analysis of Java Enterprise Applications: Frameworks and Caches, the Elephants in the Room

The Morning Paper

Static analysis of Java enterprise applications: frameworks and caches, the elephants in the room , Antoniadis et al., PLDI’20. Static analysis is a key component of many quality and security analysis tools.

Java 80
article thumbnail

Re-Architecting the Video Gatekeeper

The Netflix TechBlog

The Tech Hollow , an OSS technology we released a few years ago, has been best described as a total high-density near cache : Total : The entire dataset is cached on each node?—?there there is no eviction policy, and there are no cache misses. Near : the cache exists in RAM on any instance which requires access to the dataset.

Cache 183
article thumbnail

Local-first software: you own your data, in spite of the cloud

The Morning Paper

Local-first software: you own your data, in spite of the cloud Kleppmann et al., If you start reading this paper you could be lost for hours following all the interesting links and ideas, and end up even more dissatisfied than you already are with the state of software today. Local-first software ideals. It should be fast.

Cloud 83
article thumbnail

How It Works (It Just Runs Faster): Non-Volatile Memory SQL Server Tail Of Log Caching on NVDIMM

SQL Server According to Bob

Note: We received feedback that there was some confusion on us calling this functionality “tail of the log caching” because our documentation and prior history has referred to the tail of the log as the portion of the hardened log that has not been backed up. Tail Of Log Caching.

Cache 40
article thumbnail

Sponsored Post: pMD, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Senior DevOps Engineer : Your engineering work will focus on using your deep knowledge of the web stack including firewalls, web applications, caches and data stores ­ to create innovative infrastructure architectures that are resilient, scalable, and blazingly fast. Please apply here. Apply here. Need excellent people?