Percona

SEPTEMBER 19, 2023

This type of backup is suitable for large, important databases that need to be recovered quickly when problems occur. Physical backups are the backups that consist of raw copies of the directories and files that store database contents. The read speed is too slow, which usually is a sign of IO congestion.

C++ 104

C++ Servers Storage Speed 104

HammerDB

APRIL 19, 2023

Among the different components of modern software solutions, the database is one of the most critical. There are many times we get asked why some cloud instance performed poorly for their database application and almost always turned out to be some configuration error. For storage, FIO is generally used.

Performance 54

Performance Benchmarking Cache Storage 54

Percona

DECEMBER 20, 2018

Let’s look at some of the most popular Percona Database Performance Blog posts in 2018. With the Percona Database Performance Blog, Percona staff and leadership work hard to provide the open source community with insights, technical support, predictions and metrics around multiple open source database software technologies.

Database 40

Database Tuning Performance AWS 40

Testsigma

JULY 14, 2020

According to Wikipedia, Data-Driven Testing(DDT) is a software testing methodology that is used in the testing of computer software to describe testing done using a table of conditions directly as test inputs and verifiable outputs as well as the process where test environment settings and control are not hard-coded.

Testing 63

Testing Artificial Intelligence DevOps Big Data 63

HammerDB

MAY 5, 2019

Note that the main developer of HammerDB is Intel employee (#IAMINTEL) however HammerDB is a personal open source project and HammerDB has no optimization whatsoever for a database running on any particular architecture. in the directory storage/innobase/ut the following section has UT_RELAX_CPU defined to call the PAUSE instruction on x86.

Testing 48

Testing Tuning Latency Storage 48

SQL Performance

MARCH 17, 2020

Test Environment. I will be using the 50GB Stack Overflow 2013 database , but any large table with a low number of distinct values would do. The Stack Overflow 2013 database comes without nonclustered indexes to minimize download time. This machine has four i7 CPUs (hyperthreaded to 8) with a base speed of 2.4GHz.

Servers 86

Servers Tuning Database Efficiency 86

Percona

AUGUST 30, 2023

Data powers everything, and unlike coal and coal combustion, data and databases aren’t going away. In this blog, we’ll focus on the elements of database backup and disaster recovery, and we’ll introduce proven solutions for maintaining business continuity, even amid otherwise dire circumstances.

Database 87

Database Hardware Open Source Strategy 87

Scalegrid

FEBRUARY 1, 2024

MySQL is a popular open-source relational database management system for online applications and data warehousing. Because of this, preserving the availability and integrity of the data stored in MySQL databases requires regular backups. Having MySQL backups for your database can speed up and simplify the recovery process.

Best Practices 130

Best Practices Storage Strategy Database 130

Scalegrid

MARCH 8, 2024

With MySQL point-in-time recovery , you can restore your database to the moment before the problem occurs. Preparation for PITR is crucial and involves enabling binary logging and creating a full database backup. It is important to begin with a thorough database backup to prepare for such situations.

Database 162

Database Strategy Servers Best Practices 162

Percona

MAY 2, 2023

That’s why it’s essential to implement the best practices and strategies for MongoDB database backups. Why are MongoDB database backups important? Regular database backups are essential to protect against data loss caused by system failures, human errors, natural disasters, or cyber-attacks.

Best Practices 52

Best Practices Database Storage Servers 52

Percona

AUGUST 2, 2023

Restoring a MySQL database backup is a crucial task that can sometimes be time-consuming, especially for large databases. Linux native Input/Output (I/O) statistics Pipe viewer utility By following these approaches, we can effectively monitor the restoration process and manage your MySQL database restoration efficiently.

Database 82

Database Monitoring C++ Speed 82

All Things Distributed

APRIL 5, 2012

One of the services that is very successful in driving innovation at our customers in this context is Amazon RDS , the Relational Database Service. Amazon RDS removes the headaches of running a relational database service reliably at scale, allowing Amazon RDS customers to focus on innovation for their customers. hands freeÃ?

Innovation 146

Innovation AWS Education Network 146

Percona

MARCH 30, 2023

The use of open source databases has increased steadily in recent years. Past trepidation — about perceived vulnerabilities and performance issues — has faded as decision makers realize what an “open source database” really is and what it offers. What is an open source database?

Open Source 75

Open Source Database Storage Scalability 75

Percona

MARCH 29, 2023

Compression in any database is necessary as it has many advantages, like storage reduction, data transmission time, etc. Storage reduction alone results in significant cost savings, and we can save more data in the same space. By default, MongoDB provides a snappy block compression method for storage and network communication.

Storage 107

Storage Network Open Source Latency 107

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability.

Performance 124

Performance Hardware Tuning Storage 124

Percona

APRIL 24, 2023

I keep seeing many articles and talks on “tuning” discussing how creating new indexes speeds up SQL but rarely ones discussing removing them. This post is about PostgreSQL, but most of the problems also apply to other database systems. The total database size grows to a multiple of the actual data.

Tuning 125

Tuning Cache Storage Database 125

Scalegrid

JULY 8, 2019

Are you looking to get started with the world’s most popular open-source database, and wondering how you should setup your MySQL hosting ? While Microsoft Azure does offer a managed solution, Azure Database, the solution has some major limitations you should know about before migrating your MySQL deployments.

Azure 219

Azure Cloud Virtualization Database 219

The Morning Paper

MARCH 3, 2020

Millions of tiny databases , Brooker et al., It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. Testing a large-scale distributed system is far from easy.

Database 106

Database AWS Network Design 106

Percona

JULY 26, 2023

MongoDB is a non-relational document database that provides support for JSON-like storage. First released in 2009, it is the most used NoSQL database and has been downloaded more than 325 million times. The bigger the database, the bigger the damage from a leak. This can be due to a few different reasons.

Database 79

Database Servers Storage Strategy 79

Dynatrace

MAY 8, 2023

DevOps aims to move applications more quickly into production by releasing new builds frequently — often several times per day — and incorporating constant feedback and testing, both during development and after software is deployed. But when and how does DevOps monitoring fit into the process?

DevOps 220

DevOps Efficiency Monitoring Infrastructure 220

Percona

SEPTEMBER 6, 2023

Functional indexes are found in both of Percona’s relational databases, MySQL and PostgreSQL, but they are probably the least used and most understood index type, aside from geospatial. Thus, indexes on expressions are useful when retrieval speed is more important than insertion and update speed. id` AS `id` from `test`.`product`

Speed 81

Speed Virtualization Storage Open Source 81

Percona

AUGUST 29, 2023

A single command to deploy the operator would be: kubectl apply -f [link] --server-side Init SQL script Init SQL allows the creation of the database cluster with some initial data in it. In this case, the backups should be stored on some object storage. You can find all examples from this blog post in this GitHub repository.

Storage 94

Storage Database Media Open Source 94

Dynatrace

JANUARY 31, 2024

million” – Gartner Data observability is a practice that helps organizations understand the full lifecycle of data, from ingestion to storage and usage, to ensure data health and reliability. An erroneous change in the database system leads to a subset of the data being categorized incorrectly.

DevOps 194

DevOps Analytics Airlines Metrics 194

Percona

JANUARY 24, 2023

There will be a considerable gain if we combine this with other sets of great improvements in WAL archiving in PostgreSQL 15, as discussed in previous posts New WAL Archive Module/Library in PostgreSQL 15 and Speed Up of the WAL Archiving in PostgreSQL 15. Such “torn pages” are corruptions from the database point of view.

Database 116

Database Benchmarking Open Source Latency 116

Percona

JULY 15, 2023

One very common problem when trying to optimize a database environment is index usage. Introduction to MySQL Indexes Indexes in MySQL are database structures used to optimize data retrieval speed and efficiency. They are a roadmap that speeds up the process of finding specific rows in a large table. What is an Index?

Virtualization 77

Virtualization Speed Database Efficiency 77

Percona

AUGUST 5, 2023

Partitioning is a way in which a database (MySQL in this case) splits its actual data down into separate tables but still gets treated as a single table by the SQL layer. Otherwise, the storage engine does a scatter-gather and queries ALL partitions in a UNION that is not concurrent. So, What is MySQL Partitioning?

Strategy 40

Strategy Storage Database Best Practices 40

Percona

DECEMBER 14, 2022

I was pretty optimistic that I’d truly have impressive numbers to share but as it turns out, while there is a potential for significant advantage, a detailed testing regime of the CITUS columnar store extension should be carried out before implementing them into your own environment. Columnar storage. speeds up scans, .

Database 92

Database Analytics Storage Processing 92

Percona

SEPTEMBER 27, 2023

First, we will need to install the OS with the necessary control files for the appropriate PostgreSQL version for installing pg_partman on the database. Installation of pg_partman on the database I recommend creating the schema before creating the extension to install the extension’s objects. pg_partman_bgw.dbname : Required.

Storage 99

Storage Open Source Database Efficiency 99

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

All Things Distributed

JUNE 21, 2017

Today, I'm excited to announce the general availability of Amazon DynamoDB Accelerator (DAX) , a fully managed, highly available, in-memory cache that can speed up DynamoDB response times from milliseconds to microseconds, even at millions of requests per second. DynamoDB was the first service at AWS to use SSD storage.

Speed 121

Speed Cache Latency AWS 121

HammerDB

JUNE 27, 2022

This post is targeted towards the questions most often asked by non-technical management who want to get up to speed on what HammerDB is (what it isn’t) and how it can benefit their organization. HammerDB is a software application for database benchmarking. What is HammerDB? Why HammerDB was developed. The HammerDB name.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Brendan Gregg

NOVEMBER 29, 2017

Virtualized in Hardware**: Hardware support for virtualization, and near bare-metal speeds. In this configuration, the AMI and boot is paravirt (PV), the kernel is making hypercalls instead of privileged instructions, and the system is using paravirt network and storage drivers. I'd expect between 0.1% The AMI and boot are now HVM.

Virtualization 111

Virtualization AWS Hardware Storage 111

Testsigma

NOVEMBER 16, 2021

We shall also see how decisions are made in an enterprise and why cross-browser testing is the most important thing in 2021 to sustain a healthy business. Throughout this post, we shall see the bits of these components and relate them to the testing scenario. What does enterprise mean from a tester’s POV? Needs of an enterprise.

Testing 52

Testing Website Small Business Internet 52

Percona

AUGUST 29, 2023

Among its many capabilities, a Citus cluster can: Create distributed tables that are sharded across a cluster of PostgreSQL nodes to combine their CPU, memory, storage, and I/O capacity. Columnar storage of tables can compress data, speeding up scans and supporting fast projections, both on regular and distributed tables.

C++ 79

C++ Database Storage Testing 79

The Morning Paper

FEBRUARY 6, 2020

Cross-function communication should work at wire speed. The canononical cloud platform architecture decouples storage and compute services so that each can be scaled and operated independently, i.e., they are disaggregated. A low-latency autoscaling KVS can serve as both global storage and a DHT-like overlay network.

Lambda 98

Lambda Serverless Cache Latency 98

The Netflix TechBlog

JUNE 25, 2021

Dynomite is a high-speed in-memory database, providing highly available cross datacenter replication while preserving Redis-like semantics. The exported CQL can be a handy tool for quickly replicating data from a PROD environment to your TEST environment.

Metrics 152

Metrics Best Practices Strategy Design 152

SQL Performance

FEBRUARY 3, 2020

Other Testing. Applying page or row compression (both online/offline) to the source before the affinitized copy (offline), to see if compressing the data first could speed up the destination. I was smart and took a backup of the original source, and created a procedure to revert the database back to its initial state.

Speed 113

Speed Processing Servers Storage 113