The Morning Paper

FEBRUARY 6, 2020

On the Cloudburst design teams’ wish list: A running function’s ‘hot’ data should be kept physically nearby for low-latency access. The canononical cloud platform architecture decouples storage and compute services so that each can be scaled and operated independently, i.e., they are disaggregated.

Lambda 98

Lambda Serverless Cache Latency 98

The Morning Paper

AUGUST 29, 2019

Which I’m quite happy to see as my most recent data pipeline is based around Lambda, S3, and Athena, and it’s been working great for my use case. For cost calculations, the costs are a combination of compute costs, storage costs, data scan costs, and software license costs. The design space. Key findings. Serverless o?erings

Architecture 76

Architecture Cloud Storage Serverless 76

The Morning Paper

JUNE 23, 2019

Coupled with stateless application servers to execute business logic and a database-like system to provide persistent storage, they form a core component of popular data center service archictectures. The network latency of fetching data over the network, even considering fast data center networks. Who knew! ;).

Cache 79

Cache Latency Google Lambda 79

Highly Scalable

AUGUST 20, 2013

This article is an effort to explore techniques used by developers of in-stream data processing systems, trace the connections of these techniques to massive batch processing and OLTP/OLAP databases, and discuss how one unified query engine can support in-stream, batch, and OLAP processing at the same time. Interoperability with Hadoop.

Big Data 154

Big Data Processing Lambda Database 154

All Things Distributed

JUNE 21, 2018

A common question that I get is why do we offer so many database products? To do this, they need to be able to use multiple databases and data models within the same application. Seldom can one database fit the needs of multiple distinct use cases. Seldom can one database fit the needs of multiple distinct use cases.

Database 167

Database AWS Games Latency 167

All Things Distributed

APRIL 9, 2015

AWS has been offering a range of storage solutions: objects, block storage, databases, archiving, etc. Amazon EFS is a fully-managed service that makes it easy to set up and scale shared file storage in the AWS Cloud. With Amazon EFS, there is no minimum fee or setup costs, and customers pay only for the storage they use.

Lambda 123

Lambda Cloud IoT AWS 123

All Things Distributed

OCTOBER 12, 2016

Fast Data is an emerging industry term for information that is arriving at high volume and incredible rates, faster than traditional databases can manage. Three years ago, as part of our AWS Fast Data journey we introduced Amazon ElastiCache for Redis , a fully managed in-memory data store that operates at sub-millisecond latency.

Scalability 131

Scalability Analytics Cache AWS 131