Smashing Magazine

SEPTEMBER 28, 2022

On design systems, UX, web performance and CSS/JS. Active Memory Caching. When you want to get data that you already had quickly, you need to do caching — caching stores data that a user recently retrieved. Caching partially stores your data and is not used as permanent storage. Caching Schemes.

Cache 126

Cache Performance Servers Social Media 126

The Morning Paper

AUGUST 29, 2019

The design space. We group the DBMS design choices and tradeoffs into three broad categories, which result from the need for dealing with (A) external storage; (B) query executors that are spun on demand; and (C) DBMS-as-a-service offerings. Query performance is measured from both warm and cold caches. Key findings.

Architecture 76

Architecture Cloud Storage Serverless 76

ScaleOut Software

JULY 21, 2020

For more than fifteen years, ScaleOut StateServer® has demonstrated technology leadership as an in-memory data grid (IMDG) and distributed cache. Designed to help scalable applications deliver high performance, it stores live, fast-changing data in memory (DRAM) for fast updates and retrieval.

Analytics 52

Analytics Airlines Cache Scalability 52

ScaleOut Software

JULY 21, 2020

For more than fifteen years, ScaleOut StateServer® has demonstrated technology leadership as an in-memory data grid (IMDG) and distributed cache. Designed to help scalable applications deliver high performance, it stores live, fast-changing data in memory (DRAM) for fast updates and retrieval.

Analytics 52

Analytics Airlines Cache Scalability 52

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios.

Cache 130

Cache Storage Scalability Architecture 130

All Things Distributed

AUGUST 22, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Systems that make extensive use of caching almost all report a significant reduction in the cost of their database tier.

Cloud 117

Cloud Cache AWS Storage 117

Percona

JUNE 4, 2023

While originally designed to be a drop-in replacement for MySQL, it evolved into its own distinct database management system and is now maintained and supported by the MariaDB Foundation. In addition, MariaDB provides optimal scalability options, making it ideal for growing workloads. Contact us to learn more!

Open Source 52

Open Source Servers Storage Scalability 52

The Netflix TechBlog

NOVEMBER 3, 2022

We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe. When a new leader is elected it loads all data from external storage. The cache is kept in sync with the current leader process.

Cache 224

Cache Latency Traffic Systems 224

Percona

MAY 1, 2023

Hardware optimization : You need to ensure that the CPU, memory, and storage components meet the performance requirements of the database workload. Connection pooling: Minimizing connection overhead and improving response times for frequently accessed data by implementing mechanisms for connection pooling and caching strategies.

Tuning 52

Tuning Efficiency Database Performance 52

All Things Distributed

DECEMBER 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Jul 4 - Leases: An efficient fault-tolerant mechanism for distributed file cache consistency , Gray, Cary, and David Cheriton, Vol. Jul 6 - End-To-End Arguments in System Design , by J. All Things Distributed. The Back-to-Basics Readings of 2012.

Operating System 144

Operating System Cache AWS Scalability 144

All Things Distributed

AUGUST 17, 2011

Werner Vogels weblog on building scalable and robust distributed systems. As some of you may remember I was pretty excited when Amazon Simple Storage Service (S3) released its website feature such that I could serve this weblog completely from S3. Driving Storage Costs Down for AWS Customers. All Things Distributed.

Servers 126

Servers Social Media AWS Website 126

The Morning Paper

JUNE 16, 2019

Such a design rules out an entire class of application errors, protecting private data from accidentally leaking. Although state-of-the-are databases have security features designed for exactly this purpose, such as row-level access policies and grants of views, these features are too limiting for many web applications.

Database 90

Database Cache Benchmarking Efficiency 90

O'Reilly Software

JUNE 12, 2018

Data is all-important—vital for the continued success of our businesses—but has also been seen as a massive constraint in how we design and evolve our systems. This meant a lot of time was spent on things like cycle time analysis, build pipeline design, test automation, and infrastructure automation.

Database 72

Database Cache Architecture Latency 72

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. Often these namespaces are hierarchical in nature such that it becomes easier to manage them and to decentralize control, which makes the system more scalable. There are two main types of DNS servers: authoritative servers and caching resolvers.

Cloud 117

Cloud Internet Internet AWS 117

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Instead of worrying about infrastructure management functions, such as capacity provisioning and hardware maintenance, teams can focus on application design, deployment, and delivery. Scalability.

Serverless 279

Serverless AWS Lambda Storage 279

All Things Distributed

MARCH 5, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Amazon ElastiCache customers will see their prices drop by up to 10%, depending on their cache node types. We continuously apply all our innovative skills to the design of datacenters, servers, storage, network, etc. All Things Distributed.

AWS 110

AWS Innovation Scalability Cache 110

Percona

FEBRUARY 1, 2023

This post will look at using The Oversized-Attribute Storage Technique (TOAST) to improve performance and scalability. Therefore, TOAST is a storage technique used in PostgreSQL to handle large data objects such as images, videos, and audio files.

Storage 94

Storage Scalability Strategy Performance 94

High Scalability

JULY 20, 2018

That means multiple data indirections mean multiple cache misses. DonHopkins : NeWS differs from the current technology stack in that it was all coherently designed at once by James Gosling and David Rosenthal, by taking several steps back and thinking deeply about all the different problems it was trying to solve together.

Internet 121

Internet Internet Scalability Automotive 121

Highly Scalable

AUGUST 20, 2013

This system has been designed to supplement and succeed the existing Hadoop-based system that had too high latency of data processing and too high maintenance costs. The design of the in-stream processing engine itself was driven by the following requirements: SQL-like functionality. Fault-tolerance. Interoperability with Hadoop.

Big Data 154

Big Data Processing Lambda Database 154

Percona

MAY 15, 2023

This operation is quite expensive but our database can run it in a few milliseconds or less, thanks to several optimizations that allow the node to execute most of them in memory with no or little access to mass storage. As well, very few cases are in need to have a full system/solution to provide scalability with sharding.

Traffic 127

Traffic Scalability Database Servers 127

HammerDB

JUNE 27, 2022

Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. The TPC designed benchmarks for transaction processing (OLTP) and analytics (OLAP) and anyone can run these benchmarks, have them audited by the TPC and published on the official benchmark rankings.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

The Morning Paper

FEBRUARY 6, 2020

.’ Stateless is fine until you need state, at which point the coarse-grained solutions offered by current platforms limit the kinds of application designs that work well. On the Cloudburst design teams’ wish list: A running function’s ‘hot’ data should be kept physically nearby for low-latency access.

Lambda 98

Lambda Serverless Cache Latency 98

Percona

JULY 17, 2023

Instead of the table-based structure of relational databases, MongoDB stores data in documents and collections, a design for handling large amounts of unstructured data and for real-time web applications. DBAs and developers appreciate its combination of flexibility, scalability, and performance. Couchbase — No.

Open Source 79

Open Source Database Scalability Software 79

All Things Distributed

JANUARY 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications.

Scalability 167

Scalability Database Ecommerce Latency 167

The Morning Paper

MARCH 17, 2020

An empirical guide to the behavior and use of scalable persistent memory , Yang et al., The Optane DIMM is the first scalable, commercially available NVDIMM. So now that we know the truth about the way Optane DIMMs in App Direct mode behave, how should we design our systems to get the best out of them? FAST’20. to 0.98.

Scalability 59

Scalability Latency Cache Media 59

Percona

MAY 2, 2023

Cons of logical backups As it reads all data, it can be slow and will require disk reads too for databases that are larger than the RAM available for the WT cache—the WT cache pressure increases, which slows down the performance. Especially if going into or out of storage types that may throttle bandwidth/network traffic.

Best Practices 52

Best Practices Database Storage Servers 52

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. DynamoDB was the first service at AWS to use SSD storage.

Speed 121

Speed Cache Latency AWS 121

Particular Software

MAY 22, 2023

When one of those meetings occurs after a carb-heavy lunch, it’s easy for your mind to drift away…back to those university lectures about entity design. One cart to rule them all As the meeting continues, the design for the shopping cart begins to take shape. We all love building greenfield projects. Those are…not so fun.

Systems 98

Systems Cache Strategy Database 98

ScaleOut Software

MAY 15, 2014

For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. Given all this, we thought it would be a good opportunity to see how we are doing relative to the competition, and in particular, relative to Microsoft’s AppFabric caching for Windows on-premise servers.

Cache 40

Cache Servers Network Design 40

The Morning Paper

JUNE 23, 2019

Coupled with stateless application servers to execute business logic and a database-like system to provide persistent storage, they form a core component of popular data center service archictectures. Why are developers using RInK systems as part of their design? TBH, I never interpreted it quite so strictly.

Cache 79

Cache Latency Google Lambda 79

The Morning Paper

SEPTEMBER 10, 2019

When each of those use cases is powered by a dedicated back-end, investments in better performance, improved scalability and efficiency etc. Shared compute tier designed to scale horizontally with many small tasks rather than a small number of large tasks. Cache all the things. are divided. Little or) no local state.

Analytics 75

Analytics Latency Cache Google 75

Percona

JULY 5, 2023

The principle of locality While the principle of locality is usually related to processors and cache access patterns, it also applies to data access in general. Regarding tablespace and segment fragmentation, modern storage systems tend to reduce the impact of these types of fragmentation.

Open Source 128

Open Source Database Efficiency Testing 128

All Things Distributed

OCTOBER 2, 2017

We were pushing the limits of what was a leading commercial database at the time and were unable to sustain the availability, scalability and performance needs that our growing Amazon business demanded. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design.

Internet 128

Internet Internet AWS Performance 128

Highly Scalable

APRIL 2, 2012

Some time ago I participated in design of a backend for one large online retailer company. In particular, we built this system on top of Oracle Coherence and designed our own data structures and indexes. In particular, we built this system on top of Oracle Coherence and designed our own data structures and indexes.

Ecommerce 100

Ecommerce Cache Storage Architecture 100

Smashing Magazine

JUNE 25, 2020

Today, we’ll address storing and serving files for both single-server and scalable deployments while considering factors like compression, caching, and availability. We’ll also discuss the costs and benefits of CDNs and dedicated file storage solutions. First, you’ll need to install the libraries boto3 and django-storages.

Media 69

Media Cache Storage AWS 69

Percona

JUNE 22, 2023

Typically, the servers are configured in a primary/replica configuration, with one server designated as the primary server that handles all incoming requests and the others designated as replica servers that monitor the primary and take over its workload if it fails. This flexibility can be crucial in designing a scalable architecture.

Availability 111

Availability Database Open Source Hardware 111

All Things Distributed

JUNE 21, 2018

As I have talked about before, one of the reasons why we built Amazon DynamoDB was that Amazon was pushing the limits of what was a leading commercial database at the time and we were unable to sustain the availability, scalability, and performance needs that our growing Amazon.com business demanded. Purpose-built databases.

Database 167

Database AWS Games Latency 167