Remove Database Remove Latency Remove Software Engineering Remove Storage
article thumbnail

Designing Instagram

High Scalability

FUN FACT : In this talk , Rodrigo Schmidt, director of engineering at Instagram talks about the different challenges they have faced in scaling the data infrastructure at Instagram. We will use a graph database such as Neo4j to store the information. Sample Queries supported by Graph Database. System Components. API Design.

Design 334
article thumbnail

Millions of tiny databases

The Morning Paper

Millions of tiny databases , Brooker et al., It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. Engineering decisions involve making lots of trade-offs.

Database 106
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Achieving observability in async workflows

The Netflix TechBlog

Once you finally find useful identifiers, you may begin writing SQL queries against your production database to find out what went wrong. We are expected to process 1,000 watermarks for a single distribution in a minute, with non-linear latency growth as the number of watermarks increases.

Traffic 160
article thumbnail

Reverb: speculative debugging for web applications

The Morning Paper

Reverb also take a snapshot of the client’s local storage (e.g. If the server-side responder is also being replayed, then Reverb inserts a new request into the server-side log… When the response is generated, Reverb buffers it and uses a model of network latency to determine where to inject the response into the client-side log.