Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. With these goals in mind, two in-memory data stores, Redis and Memcached, have emerged as the top contenders.

Cache 130

Cache Storage Scalability Architecture 130

Highly Scalable

AUGUST 20, 2013

The shortcomings and drawbacks of batch-oriented data processing were widely recognized by the Big Data community quite a long time ago. The engine should be compact and efficient, so one can deploy it in multiple datacenters on small clusters. High performance and mobility. Pipelining.

Big Data 154

Big Data Processing Lambda Database 154

Scalegrid

FEBRUARY 8, 2024

Their design emphasizes increasing availability by spreading out files among different nodes or servers — this approach significantly reduces risks associated with losing or corrupting data due to node failure. This strategy reduces the volume needed during retrieval operations.

Storage 130

Storage Systems Big Data Azure 130

Dynatrace

OCTOBER 4, 2022

While data lakes and data warehousing architectures are commonly used modes for storing and analyzing data, a data lakehouse is an efficient third way to store and analyze data that unifies the two architectures while preserving the benefits of both. What is a data lakehouse?

Artificial Intelligence 214

Artificial Intelligence Storage Analytics Government 214

ACM Sigarch

MAY 31, 2023

Introduction Memory systems are evolving into heterogeneous and composable architectures. Heterogeneous and Composable Memory (HCM) offers a feasible solution for terabyte- or petabyte-scale systems, addressing the performance and efficiency demands of emerging big-data applications.

Latency 52

Latency Hardware Cache Architecture 52

The Morning Paper

OCTOBER 26, 2020

On the surface this is a paper about fast data ingestion from high-volume streams, with indexing to support efficient querying. Helios also serves as a reference architecture for how Microsoft envisions its next generation of distributed big-data processing systems being built.

Cloud 104

Cloud Big Data Latency Architecture 104

The Morning Paper

MAY 14, 2019

Seer: leveraging big data to navigate the complexity of performance debugging in cloud microservices Gan et al., We’re not told how Seer figures out that a major architectural change has happened. An equally large fraction are due to compute contention, followed by network, cache, memory, and disk contention.

Big Data 45

Big Data Cloud Performance Hardware 45