article thumbnail

File systems unfit as distributed storage backends: lessons from ten years of Ceph evolution

The Morning Paper

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19. This is not surprising in hindsight.

Storage 64
article thumbnail

A Decade of Dynamo: Powering the next wave of high-performance, internet-scale applications

All Things Distributed

It all started in 2004 when Amazon was running Oracle's enterprise edition with clustering and replication. We were pushing the limits of what was a leading commercial database at the time and were unable to sustain the availability, scalability and performance needs that our growing Amazon business demanded.

Internet 128
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Remembering Freeman Dyson

O'Reilly

When I interviewed Freeman on stage at OSCON in 2004 , along with his son George, the subject strayed to digital preservation. I lamented how much would be lost due to incompatible standards for information storage, and he said, “Oh no, forgetting is so important! It is what gives room for new ideas to come in.”

Storage 142
article thumbnail

What Adrian Did Next?—?Part 2?—?Sun Microsystems

Adrian Cockcroft

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. Rich became co-author of the second edition of the Sun Performance Tuning book, to describe how it worked.

Tuning 52
article thumbnail

Data Redundancy With the PostgreSQL Citus Extension

Percona

Among its many capabilities, a Citus cluster can: Create distributed tables that are sharded across a cluster of PostgreSQL nodes to combine their CPU, memory, storage, and I/O capacity. Reference tables can be replicated to all nodes for joins and foreign keys from distributed tables and for maximum read performance.

C++ 80
article thumbnail

DynamoDB One Year Later - All Things Distributed

All Things Distributed

Indexed Storage costs : We are lowering the price of indexed storage by 75%. Virginia) Region, the price of data storage will drop from $1 per GB per month to $0.25. DynamoDB runs on a fleet of SSD-backed storage servers that are specifically designed to support DynamoDB. s prices by 70%. For example, in our US East (N.

Ecommerce 139
article thumbnail

AVIF for Next-Generation Image Coding

The Netflix TechBlog

JPEG can ingest RGB data and transform it to a luma-chroma representation before performing lossy compression. With the motion extension, it was accepted as the video coding standard for digital cinema in 2004. We also highlight the best performer in the tables below. This is followed by quantization and entropy coding.

Code 212