O'Reilly Software

JUNE 12, 2018

Back then, the most common pattern I saw for service-based systems was sharing a database among multiple services. The rationale was simple: the data I need is already in this other database, and accessing a database is easy, so I’ll just reach in and grab what I need. Well-defined interfaces are key, as is hiding information.

Database 72

Database Cache Architecture Latency 72

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

Percona

JULY 25, 2023

Percona XtraBackup performs crash recovery on the files to make a consistent, usable database again. The redo apply phase wouldn’t make the database consistent with respect to a transaction. Initializing a DD engine and the cache adds complexity and other server dependencies. ibd2sdi data/test/t1.ibd ibd > t1.sdi

Cache 85

Cache Benchmarking Servers Design 85

SQL Server According to Bob

NOVEMBER 8, 2016

Note: We received feedback that there was some confusion on us calling this functionality “tail of the log caching” because our documentation and prior history has referred to the tail of the log as the portion of the hardened log that has not been backed up. Block storage is what you think of today as disk access.

Cache 40

Cache Servers Media Storage 40

Percona

JUNE 4, 2023

Before we dive into the differences between MariaDB and MySQL, we will provide a thorough examination of each relational database management system (RDBMS). While originally designed to be a drop-in replacement for MySQL, it evolved into its own distinct database management system and is now maintained and supported by the MariaDB Foundation.

Open Source 52

Open Source Servers Storage Scalability 52

Scalegrid

MARCH 28, 2024

Key Takeaways Redis offers complex data structures and additional features for versatile data handling, while Memcached excels in simplicity with a fast, multi-threaded architecture for basic caching needs. Redis is better suited for complex data models, and Memcached is better suited for high-throughput, string-based caching scenarios.

Cache 130

Cache Storage Scalability Architecture 130

Dynatrace

OCTOBER 15, 2021

The data is incredibly plentiful and difficult to store over long periods due to capacity limitations — a reason why private and public cloud storage services have been a boon to DevOps teams. This occurs once data is safely stored within a local cache. Monitoring begins here. What happened to OpenTracing and OpenCensus?

Open Source 221

Open Source Metrics Cloud Transportation 221

All Things Distributed

AUGUST 22, 2011

Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Amazon ElastiCache handles the complexity of creating, scaling and managing an in-memory cache to free up brainpower for more differentiating activities. blog comments powered by Disqus.

Cloud 117

Cloud Cache AWS Storage 117

ScaleOut Software

JUNE 22, 2020

From Distributed Caches to Real-Time Digital Twins. In general terms, in-memory computing refers to the related concepts of (a) storing fast-changing data in primary memory instead of in secondary storage and (b) employing scalable computing techniques to distribute a workload across a cluster of servers.

Ecommerce 52

Ecommerce Cache Scalability IoT 52

ScaleOut Software

JUNE 22, 2020

From Distributed Caches to Real-Time Digital Twins. In general terms, in-memory computing refers to the related concepts of (a) storing fast-changing data in primary memory instead of in secondary storage and (b) employing scalable computing techniques to distribute a workload across a cluster of servers.

Ecommerce 52

Ecommerce Cache Scalability IoT 52

The Netflix TechBlog

OCTOBER 15, 2019

caching (Memcached etc.), To address these challenges, we developed Delta. Thus, ensuring the atomicity of writes across different storage technologies remains a challenging problem for applications [3]. Our goal was to abstract those complexities from application developers so they can focus on implementing business features.

Transportation 192

Transportation Architecture Processing Storage 192

The Morning Paper

MARCH 10, 2020

Therefore, using the benchmarking results of YCSB as guidance for production might cause some misleading results… To address this issue, we propose a key-range based modelling and develop a benchmark that can better emulate the workloads of real-world key-value stores. It matters because RocksDB reads from storage in data blocks (e.g.

Benchmarking 59

Benchmarking Storage Cache Open Source 59

Dynatrace

SEPTEMBER 17, 2019

What we need though is data that is automatically connected with context for k8s administrators, architects and developers to better understand what is going in the part of k8s that’s relevant to them and how does it impact those parts that are relevant for their colleagues. PostgreSQL & Elastic for data storage. REDIS for caching.

AWS 128

AWS Monitoring Ecommerce Lambda 128

Smashing Magazine

SEPTEMBER 20, 2021

Search Engine And Web Archive Cached Results. Another common category of imposter domains are domains used by search engines for delivering cached results or archived versions of page views. The message that appears above a cached search result in Google’s search service. Developer Tools. Large preview ). Large preview ).

Website 89

Website Analytics Google Cache 89

Smashing Magazine

NOVEMBER 2, 2021

Cost-Efficient And Effort-Saving Development. On the contrary, a native application of an e-commerce store can come at 30, 50, or even 100 MB and up, consuming internal device storage. These multiple “heads” are attached to the backend and database. Below are some main things to consider. Image credit: Apivita. Large preview ).

Code 74

Code Cache Retail Mobile 74

All Things Distributed

AUGUST 17, 2011

As some of you may remember I was pretty excited when Amazon Simple Storage Service (S3) released its website feature such that I could serve this weblog completely from S3. Cactus is a static website generator developed by Koen Bok of Made By Sofa (recently acquired by Facebook ). Driving Storage Costs Down for AWS Customers.

Servers 126

Servers Social Media AWS Website 126

Scalegrid

DECEMBER 21, 2023

Redis® Monitoring Essentials Ensuring the performance, reliability, and safety of a Redis® database requires active monitoring. With these essential support systems in place, you can effectively monitor your databases with up-to-date data about their health and functioning status at all times.

Strategy 130

Strategy Monitoring Latency DevOps 130

Percona

AUGUST 10, 2018

The performance of a PostgreSQL database can be compromised by dead tuples, since they continue to occupy space and can lead to bloat. Now, though, it’s time to look at autovacuum for postgres, and the internals you to know to maintain a high performance PostgreSQL database needed by demanding applications. Is this a problem ?

Tuning 44

Tuning Cache Database Storage 44

All Things Distributed

DECEMBER 5, 2010

There are two main types of DNS servers: authoritative servers and caching resolvers. But the real robustness of the DNS system comes through the way lookups are handled, which is what caching resolvers do. Caching techniques ensure that the DNS system doesnt get overloaded with queries. blog comments powered by Disqus.

Cloud 117

Cloud Internet Internet AWS 117

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Speed is next; serverless solutions are quick to spin up or down as needed, and there are no delays due to limited storage or resource access. AWS offers four serverless offerings for storage.

Serverless 283

Serverless AWS Lambda Storage 283

SQL Performance

MAY 16, 2019

The following script should be run on a development SQL Server instance in a new test database set to use the SIMPLE or BULK_LOGGED recovery model. The calculated row size (61 bytes) differs from the true row storage size (60 bytes) by the extra one byte of internal metadata present in the insert stream. Trace Flag.

Cache 67

Cache Servers Testing Storage 67

Percona

APRIL 24, 2023

This post is about PostgreSQL, but most of the problems also apply to other database systems. The more indexes, the more the requirement of memory for effective caching. Indexes need more cache than tables Due to random writes and reads, indexes need more pages to be in the cache.

Tuning 126

Tuning Cache Storage Database 126

Percona

MAY 6, 2024

Since Valkey (a fork of Redis) is around the corner, I thought to write a short blog post about some of the configuration parts, mainly discussing how to dynamically change certain settings and persist those inside the configuration file.Disk persistenceLet me start with a very important setting, which is “SAVE,” that helps in performing (..)

Performance 55

Performance Cache Hardware Storage 55

Highly Scalable

AUGUST 20, 2013

This article is an effort to explore techniques used by developers of in-stream data processing systems, trace the connections of these techniques to massive batch processing and OLTP/OLAP databases, and discuss how one unified query engine can support in-stream, batch, and OLAP processing at the same time. Partitioning and Shuffling.

Big Data 154

Big Data Processing Lambda Database 154

Smashing Magazine

JANUARY 15, 2019

As web developers, it’s understandable to feel that this is not an issue over which we have any influence, but this isn’t true. The Green Web Foundation maintains an ever-growing database of web hosts who are either wholly powered by renewable energy or are at least committed to being carbon neutral. These include data transfer (i.e.

Website Performance 73

Website Performance Website Energy Performance 73

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. A basic high availability database system provides failover (preferably automatic) from a primary database node to redundant nodes within a cluster. HA is sometimes confused with “fault tolerance.”

Availability 107

Availability Database Open Source Hardware 107

Smashing Magazine

MAY 25, 2022

Memory and performance management are important aspects of software development and ones that every software developer should pay attention to. According to Mozilla Developer Network, the Map object holds key-value pairs and remembers the original insertion order of the keys. Understanding Weak Reference In JavaScript.

Cache 116

Cache Programming Storage Code 116

All Things Distributed

JUNE 21, 2018

A common question that I get is why do we offer so many database products? The answer for me is simple: Developers want their applications to be well architected and scale effectively. To do this, they need to be able to use multiple databases and data models within the same application. The opposite is true.

Database 167

Database AWS Games Latency 167

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. It enables the user to measure database performance and make comparative judgements about database hardware and software. Why HammerDB was developed. Originally, HammerDB was named Hammerora because the first database the application supported was Oracle.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Percona

JULY 17, 2023

MongoDB Community Edition software might set the stage for achieving your high-volume database goals, but you quickly learn that its features fall short of your enterprise needs. The popularity of MongoDB MongoDB has emerged as a popular database platform. 5 among all database management systems and No. It ranks No.

Open Source 75

Open Source Database Scalability Software 75

Smashing Magazine

DECEMBER 23, 2020

It doesn’t come as a surprise, considering the benefits of higher conversion rates, customer engagement, decreased page loading speed, and lower costs on development and overhead. The good news is that developing a PWA isn’t something that only big-budget companies can afford. Cached content with IndexedDB. Service Workers.

Cache 123

Cache Internet Internet Google 123

Highly Scalable

SEPTEMBER 18, 2012

These developments gradually highlight a system of relevant database building blocks with proven practical efficiency. In this article I’m trying to provide more or less systematic description of techniques related to distributed operations in NoSQL databases. Data Placement. System Coordination. Read/Write latency.

Database 213

Database Latency C++ Scalability 213

Percona

JULY 5, 2023

Fragmentation is a common concern in some database systems. In databases, we can experiment with different types of fragmentation: Segment Fragmentation : segments are fragmented; they are stored not following the order of data, or there are empty pages gaps between the data pages. What is fragmentation?

Open Source 125

Open Source Database Efficiency Testing 125

All Things Distributed

JANUARY 18, 2012

a Fast and Scalable NoSQL Database Service Designed for Internet Scale Applications. Today is a very exciting day as we release Amazon DynamoDB , a fast, highly reliable and cost-effective NoSQL database service designed for internet scale applications. Werner Vogels weblog on building scalable and robust distributed systems.

Scalability 167

Scalability Database Ecommerce Latency 167

Percona

MAY 15, 2023

The main reason behind this is that MySQL is a relational database system (RDBMS), and any data that is going to be written in it must respect the RDBMS rules. In shard-nothing, each shard can live in a totally separate logical schema instance / physical database server/data center/continent. The POC Why this POC?

Traffic 123

Traffic Scalability Database Servers 123

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Lambda 98

Lambda Serverless Cache Latency 98

Particular Software

MAY 22, 2023

More attributes, more problems During development, we start to see some flaws in the plan. For example, you might need the data to be denormalized for performance, or the warehouse data might exist on a physically different system that can’t participate in a database join. It gets worse.

Systems 98

Systems Cache Strategy Database 98