Percona

FEBRUARY 15, 2023

For good performance, the filter blocks are cached in the RocksDB block cache and normally stay there since they are accessed frequently. LSM storage engines like MyRocks are very different from the more common B-Tree-based storage engines like InnoDB. Download Percona Distribution for MySQL Today

Storage 130

Storage Tuning Cache Engineering 130

Dynatrace

JANUARY 16, 2023

The study analyzes factual Kubernetes production data from thousands of organizations worldwide that are using the Dynatrace Software Intelligence Platform to keep their Kubernetes clusters secure, healthy, and high performing. Through effortless provisioning, a larger number of small hosts provide a cost-effective and scalable platform.

Open Source 342

Open Source Java Operating System Programming 342

Percona

MARCH 17, 2023

These updates are designed to keep databases running at peak performance and simplify database operations. But as companies grow and see more demand for their databases, we need to ensure that PMM also remains scalable so you don’t need to worry about its performance while tending to the rest of your environment.

Monitoring 102

Monitoring Scalability Cache Database 102

The Morning Paper

NOVEMBER 5, 2019

File systems unfit as distributed storage backends: lessons from 10 years of Ceph evolution Aghayev et al., In this case, the assumption that a distributed storage backend should clearly be layered on top of a local file system. What is a distributed storage backend? SOSP’19. This is not surprising in hindsight.

Storage 64

Storage Systems Hardware Efficiency 64

Scalegrid

FEBRUARY 8, 2024

A distributed storage system is foundational in today’s data-driven landscape, ensuring data spread over multiple servers is reliable, accessible, and manageable. Understanding distributed storage is imperative as data volumes and the need for robust storage solutions rise.

Storage 130

Storage Systems Big Data Azure 130

Percona

MAY 1, 2023

In this blog post, we will delve into the world of PostgreSQL performance tuning and establish some basic guidelines for setting database parameters to enhance the performance of your PostgreSQL database, based on the workload. What is PostgreSQL performance tuning? Why is PostgreSQL performance tuning important?

Tuning 52

Tuning Efficiency Database Performance 52

The Netflix TechBlog

MAY 4, 2023

The first phase involves validating functional correctness, scalability, and performance concerns and ensuring the new systems’ resilience before the migration. These include Quality-of-Experience(QoE) measurements at the customer device level, Service-Level-Agreements (SLAs), and business-level Key-Performance-Indicators(KPIs).

Traffic 339

Traffic Latency Tuning Systems 339

The Morning Paper

AUGUST 29, 2019

We group the DBMS design choices and tradeoffs into three broad categories, which result from the need for dealing with (A) external storage; (B) query executors that are spun on demand; and (C) DBMS-as-a-service offerings. InS does now offer an NVMe variant too, and the authors perform limited testing on that as well. Key findings.

Architecture 76

Architecture Cloud Storage Serverless 76

ScaleOut Software

JUNE 22, 2020

From Distributed Caches to Real-Time Digital Twins. In general terms, in-memory computing refers to the related concepts of (a) storing fast-changing data in primary memory instead of in secondary storage and (b) employing scalable computing techniques to distribute a workload across a cluster of servers.

Ecommerce 52

Ecommerce Cache Scalability IoT 52

ScaleOut Software

JUNE 22, 2020

From Distributed Caches to Real-Time Digital Twins. In general terms, in-memory computing refers to the related concepts of (a) storing fast-changing data in primary memory instead of in secondary storage and (b) employing scalable computing techniques to distribute a workload across a cluster of servers.

Ecommerce 52

Ecommerce Cache Scalability IoT 52

Dynatrace

NOVEMBER 5, 2019

Application Insights – Collects performance metrics of the application code. In addition to the OneAgent collecting all these metrics, Dynatrace has an integration with Azure Monitor to capture additional metrics for platform services such as Storage Accounts, Redis Cache, API Management Services, Load Balancers among others.

Azure 137

Azure Artificial Intelligence Metrics Innovation 137

ScaleOut Software

JULY 21, 2020

For more than fifteen years, ScaleOut StateServer® has demonstrated technology leadership as an in-memory data grid (IMDG) and distributed cache. Designed to help scalable applications deliver high performance, it stores live, fast-changing data in memory (DRAM) for fast updates and retrieval.

Analytics 52

Analytics Airlines Cache Scalability 52

ScaleOut Software

JULY 21, 2020

For more than fifteen years, ScaleOut StateServer® has demonstrated technology leadership as an in-memory data grid (IMDG) and distributed cache. Designed to help scalable applications deliver high performance, it stores live, fast-changing data in memory (DRAM) for fast updates and retrieval.

Analytics 52

Analytics Airlines Cache Scalability 52

Percona

JUNE 4, 2023

MariaDB retains compatibility with MySQL, offers support for different programming languages, including Python, PHP, Java, and Perl, and works with all major open source storage engines such as MyRocks, Aria, and InnoDB. In addition, MariaDB provides optimal scalability options, making it ideal for growing workloads.

Open Source 52

Open Source Servers Storage Scalability 52

Scalegrid

MARCH 28, 2024

In this comparison of Redis vs Memcached, we strip away the complexity, focusing on each in-memory data store’s performance, scalability, and unique features. Redis and Memcached both provide high performance with sub-millisecond response times. Managed DBaaS solutions like ScaleGrid.io

Cache 130

Cache Storage Scalability Architecture 130

All Things Distributed

AUGUST 22, 2011

Werner Vogels weblog on building scalable and robust distributed systems. Today AWS has launched Amazon ElastiCache , a new service that makes it easy to add distributed in-memory caching to any application. Systems that make extensive use of caching almost all report a significant reduction in the cost of their database tier.

Cloud 117

Cloud Cache AWS Storage 117

The Netflix TechBlog

NOVEMBER 3, 2022

We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe. When a new leader is elected it loads all data from external storage. The cache is kept in sync with the current leader process.

Cache 224

Cache Latency Traffic Systems 224

Dynatrace

SEPTEMBER 17, 2019

PostgreSQL & Elastic for data storage. REDIS for caching. Robert’s AWS & EKS admin team are monitoring most services with that capability but found it beneficial for them to have Dynatrace monitor Elastic File Storage (EFS). 2: Automate Quality aka “Performance as a Self-Service”. NGINX as an API Gateway.

AWS 127

AWS Monitoring Ecommerce Lambda 127

All Things Distributed

DECEMBER 18, 2012

Werner Vogels weblog on building scalable and robust distributed systems. Jul 4 - Leases: An efficient fault-tolerant mechanism for distributed file cache consistency , Gray, Cary, and David Cheriton, Vol. Aug 17 - SEDA: An Architecture for Well-Conditioned, Scalable Internet Services , Matt Welsh, David Culler, and Eric Brewer.

Operating System 144

Operating System Cache AWS Scalability 144

Percona

MARCH 23, 2023

This blog is in reference to our previous ones for ‘Innodb Performance Optimizations Basics’ 2007 and 2013. Although there have been many blogs about adjusting MySQL variables for better performance since then, I think this topic deserves a blog update since the last update was a decade ago, and MySQL 5.7

Performance 129

Performance Hardware Tuning Storage 129

Percona

FEBRUARY 1, 2023

PostgreSQL is a fantastic database, but if you’re storing images, video, audio files, or other large data objects, you need to “toast” them to get optimal performance. This post will look at using The Oversized-Attribute Storage Technique (TOAST) to improve performance and scalability.

Storage 94

Storage Scalability Strategy Performance 94

The Morning Paper

JUNE 16, 2019

For good query performance we’d like to pre-compute these per-user universes. If we do that naively though, we’re going to end up with a lot of universes to store and maintain and the storage requirements alone will be prohibitive. It therefore requires partially-materialized views that support high-performance updates.

Database 90

Database Cache Benchmarking Efficiency 90

All Things Distributed

DECEMBER 5, 2010

Werner Vogels weblog on building scalable and robust distributed systems. I am very excited that today we have launched Amazon Route 53, a high-performance and highly-available Domain Name System (DNS) service. There are two main types of DNS servers: authoritative servers and caching resolvers. All Things Distributed.

Cloud 117

Cloud Internet Internet AWS 117

Scalegrid

DECEMBER 21, 2023

Buckle up as we delve into the world of Redis® monitoring, exploring the most important Redis® metrics, discussing essential tools, and even peering into the future of Redis® performance management. Key Takeaways Redis® monitoring is essential for safeguarding performance, reliability, and security.

Strategy 130

Strategy Monitoring Latency DevOps 130

Dynatrace

OCTOBER 7, 2021

This means you no longer have to provision, scale, and maintain servers to run your applications, databases, and storage systems. Speed is next; serverless solutions are quick to spin up or down as needed, and there are no delays due to limited storage or resource access. Scalability. Finally, there’s scalability.

Serverless 279

Serverless AWS Lambda Storage 279

ScaleOut Software

APRIL 22, 2020

The Solution: Distributed Caching. The solution to this challenge is to use scalable, memory-based data storage for fast-changing data so that web sites can keep up with exploding workloads. It’s not enough simply to lash together a set of servers hosting a collection of in-memory caches.

Cache 52

Cache Storage Servers Database 52

ScaleOut Software

APRIL 22, 2020

The Solution: Distributed Caching. The solution to this challenge is to use scalable, memory-based data storage for fast-changing data so that web sites can keep up with exploding workloads. It’s not enough simply to lash together a set of servers hosting a collection of in-memory caches.

Cache 52

Cache Storage Servers Database 52

High Scalability

JULY 20, 2018

That means multiple data indirections mean multiple cache misses. This is where your performance goes. Mark LaPedus : MRAM, a next-generation memory type, is being touted as a replacement for embedded flash and cache applications. They are very expensive. Some say MRAM will never work in automotive. There are a few more quotes.

Internet 121

Internet Internet Scalability Automotive 121

High Scalability

FEBRUARY 19, 2019

Redis Cluster is the native sharding implementation available within Redis that allows you to automatically distribute your data across multiple nodes without having to rely on external tools and utilities. At ScaleGrid, we recently added support for Redis Clusters on our platform through our fully managed Redis hosting plans.

Availability 204

Availability Open Source Cache Storage 204

All Things Distributed

OCTOBER 12, 2016

Since then we’ve introduced Amazon Kinesis for real-time streaming data, AWS Lambda for serverless processing, Apache Spark analytics on EMR, and Amazon QuickSight for high performance Business Intelligence. Amazon’s enhancements address many day-to-day challenges with running Redis.

Scalability 130

Scalability Analytics Cache AWS 130

Percona

JULY 17, 2023

DBAs and developers appreciate its combination of flexibility, scalability, and performance. Customers miss out on the cost-effectiveness, creative freedom, and global community support (for innovation, better performance, and enhanced security) that come with open source solutions and from companies with an open source spirit.

Open Source 79

Open Source Database Scalability Software 79

Percona

MAY 15, 2023

This operation is quite expensive but our database can run it in a few milliseconds or less, thanks to several optimizations that allow the node to execute most of them in memory with no or little access to mass storage. In the MySQL open source ecosystem, we have only two consolidated ways to perform sharding — Vitess and ProxySQL.

Traffic 127

Traffic Scalability Database Servers 127

HammerDB

JUNE 27, 2022

It enables the user to measure database performance and make comparative judgements about database hardware and software. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here. Cached vs Scaled Workloads. What is HammerDB?

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Highly Scalable

AUGUST 20, 2013

The pipelines can be stateful and the engine’s middleware should provide a persistent storage to enable state checkpointing. High performance and mobility. The system should deliver performance of tens of thousands messages per second even on clusters of minimal size. Interoperability with Hadoop. Divide and broadcast join.

Big Data 154

Big Data Processing Lambda Database 154

Percona

MAY 2, 2023

PBM is a fully-supported community backup tool capable of performing cluster-side consistent backups in MongoDB for replica sets and sharded clusters. The speed of backup also depends on allocated IOPS and type of storage since lots of read/writes would be happening during this process.

Best Practices 52

Best Practices Database Storage Servers 52

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Lambda 98

Lambda Serverless Cache Latency 98

The Morning Paper

MARCH 17, 2020

An empirical guide to the behavior and use of scalable persistent memory , Yang et al., Based on these findings, the authors present four guidelines to get the best performance out of this memory today. The Optane DIMM is the first scalable, commercially available NVDIMM. Understanding Optane DIMM performance.

Scalability 59

Scalability Latency Cache Media 59