article thumbnail

Article: Magic Pocket: Dropbox’s Exabyte-Scale Blob Storage System

InfoQ

A horizontally scalable exabyte-scale blob storage system which operates out of multiple regions, Magic Pocket is used to store all of Dropbox’s data. Adopting SMR technology and erasure codes, the system has extremely high durability guarantees but is cheaper than operating in the cloud. By Facundo Agriel

Storage 107
article thumbnail

Presentation: Magic Pocket: Dropbox’s Exabyte-Scale Blob Storage System

InfoQ

Facundo Agriel dives into the architecture of Magic Pocket, some early key design patterns, and the challenges of operating such a system at this scale. By Facundo Agriel

Systems 52
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Improved Alerting with Atlas Streaming Eval

The Netflix TechBlog

Engineers want their alerting system to be realtime, reliable, and actionable. A few years ago, we were paged by our SRE team due to our Metrics Alerting System falling behind — critical application health alerts reached engineers 45 minutes late! In other words, false positives are bad but false negatives are the absolute worst!

Storage 288
article thumbnail

What is a Distributed Storage System

Scalegrid

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. This guide delves into how these systems work, the challenges they solve, and their essential role in businesses and technology.

Storage 130
article thumbnail

Measuring the importance of data quality to causal AI success

Dynatrace

Traditional analytics and AI systems rely on statistical models to correlate events with possible causes. It removes much of the guesswork of untangling complex system issues and establishes with certainty why a problem occurred. Fragmented and siloed data storage can create inconsistencies and redundancies. Timeliness.

article thumbnail

Building an elastic query engine on disaggregated storage

The Morning Paper

Building an elastic query engine on disaggregated storage , Vuppalapati, NSDI’20. have altered the many assumptions that guided the design and optimization of the Snowflake system. The caching use case may be the most familiar, but in fact it’s not the primary purpose of the ephemeral storage service.

Storage 112
article thumbnail

What Should You Know About Graph Database’s Scalability?

DZone

Having a distributed and scalable graph database system is highly sought after in many enterprise scenarios. Do Not Be Misled Designing and implementing a scalable graph database system has never been a trivial task.