Percona

NOVEMBER 3, 2023

When it comes to Citus, successfully building out and scaling a PostgreSQL cluster across multiple nodes and even across data centers can feel, at times, to be an art form because there are so many ways of building it out. Steps Provisioning The first step is to provision the four nodes with both PostgreSQL and Citus.

Database 104

Database Benchmarking Latency C++ 104

Scalegrid

DECEMBER 6, 2023

In the digital age, data management has transformed from locally hosted servers to cloud solutions. Though it may be overwhelming, there can still be great appeal when one has control over their own data privacy requirements depending on how customization is desired by the organization itself.

Database 130

Database Cloud Hardware Storage 130

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Some servers may need a few GBs of RAM, while others may need hundreds of GBs or even terabytes of RAM. Benchmark before you decide.

Performance 125

Performance Hardware Tuning Storage 125

Brendan Gregg

JUNE 30, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 54

Benchmarking Latency Cache Network 54

Percona

APRIL 7, 2023

If we were to select the most important MySQL setting, if we were given a freshly installed MySQL or Percona Server for MySQL and could only tune a single MySQL variable, which one would it be? Sysbench ran on a third server, which I’ll refer to as the application server (APP).

Tuning 135

Tuning Cache Servers Benchmarking 135

Percona

JUNE 22, 2023

As a MySQL database administrator, keeping a close eye on the performance of your MySQL server is crucial to ensure optimal database operations. However, simply deploying a monitoring tool is not enough; you need to know which Key Performance Indicators (KPIs) to monitor to gain insights into your MySQL server’s health and performance.

Performance 104

Performance Monitoring Traffic Database 104

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Brendan Gregg

JUNE 29, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 40

Benchmarking Latency Cache Network 40

SQL Performance

NOVEMBER 18, 2019

Migrating an on-premises SQL Server instance to an Azure Virtual Machine (VM) is a common method to migrate to Azure. IT professionals are familiar with scoping the size of VMs with regards to vCPU, memory, and storage capacity. Compute optimized – High CPU-to-memory ration, medium traffic web servers and application servers.

Azure 76

Azure Benchmarking Storage Virtualization 76

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For storage, FIO is generally used. Benchmarking the target Two of the more popular database benchmarks for MySQL are HammerDB and sysbench. 0.42 %sys 9.52

Performance 54

Performance Benchmarking Cache Storage 54

Percona

MARCH 17, 2023

PMM2 uses VictoriaMetrics (VM) as its metrics storage engine. Planning for resources of a PMM Server host instance can be tricky because the numbers can change depending on the DB instances being monitored by PMM. 25 Bytes, or you should plan storage roughly between 500 GB – one TB for a default 30 day retention period.

Monitoring 98

Monitoring Scalability Cache Database 98

Percona

JULY 25, 2023

When a new node joins the cluster, SST is performed to receive the data from DONOR to the JOINER. JOINER uses PXB to stream the data directory from DONOR. Percona XtraBackup copies the InnoDB data files. Percona XtraBackup copies the InnoDB data files. JOINER must prepare the backup before using it.

Cache 85

Cache Benchmarking Servers Design 85

Percona

DECEMBER 23, 2022

I wrote this post on MyRocks because I believe it is the most interesting new MySQL storage engine to have appeared over the last few years. The use case is the TPC-C benchmark but executed not on a high-end server but on a lower-spec virtual machine that is I/O limited like for example, with AWS EBS volumes. Conclusion.

Storage 55

Storage Cache C++ Virtualization 55

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Percona

JANUARY 19, 2023

With disks being faster nowadays and CPU and memory resources being cheaper, we could easily say MySQL can handle TBs of data with good performance. For instance, in Percona Managed Services , we have many clients with TBs worth of data that are well performant. There are many compression tools and algorithms for data out there.

Open Source 87

Open Source Storage Database Big Data 87

Percona

JUNE 22, 2023

To make data count and to ensure cloud computing is unabated, companies and organizations must have highly available databases. Fault tolerance aims for zero downtime and data loss. Data replication : Data is continually copied from one database to another to ensure that the system remains operational even if one database fails.

Availability 107

Availability Database Open Source Hardware 107

The Netflix TechBlog

SEPTEMBER 2, 2020

With request tracing and additional data from logs, events, metadata, and analysis, Edgar is able to show the flow of a request through our distributed system?—?what But, there are a few substantial differences in how Edgar approaches its data and its users. starting and finishing a method).

Latency 296

Latency Transportation Engineering Traffic 296

Percona

JULY 1, 2023

It efficiently manages read and write operations, optimizes data access, and minimizes contention, resulting in high throughput and low latency to ensure that applications perform at their best. These automated features reduce the burden on DBAs and organizations for their data protection efforts by simplifying database backups and recovery.

AWS 52

AWS Database Serverless Storage 52

Percona

SEPTEMBER 1, 2023

Reduced Resource Usage Optimizing resource-intensive queries and configurations can lead to a reduced burden on your server. Scalability As your data volume and user base expand, a finely tuned database can seamlessly accommodate increased workloads without compromising performance.

Tuning 52

Tuning Database Performance Hardware 52

HammerDB

NOVEMBER 5, 2018

If you are new to running Oracle, SQL Server, MySQL and PostgreSQL TPC-C workloads with HammerDB and have needed to investigate I/O performance the chances are that you have experienced waits on writing to the Redo, Transaction Log or WAL depending on the database you are testing. Logging Waits.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Percona

MAY 1, 2023

Hardware optimization : You need to ensure that the CPU, memory, and storage components meet the performance requirements of the database workload. Connection pooling: Minimizing connection overhead and improving response times for frequently accessed data by implementing mechanisms for connection pooling and caching strategies.

Tuning 52

Tuning Efficiency Database Performance 52

Percona

JANUARY 24, 2023

Reduced WAL segment size has further gains in replication and backup because less data need to be transmitted. Those users who opt-in for FP compression after analyzing their workload could just set the parameter wal_compression on all supported PostgreSQL versions and signal the server as superuser. What is Full Page Writes?

Database 116

Database Benchmarking Open Source Latency 116

SQL Server According to Bob

JANUARY 11, 2020

Microsoft SQL Server I/O Basics Author: ​​ Bob Dorr, Microsoft SQL Server Escalation Published: ​​ December, 2004 SUMMARY: ​​ Learn the I/O requirements for Microsoft SQL Server database file operations. This will help you increase system performance and avoid I/O environment errors.

Servers 40

Servers Cache Media Hardware 40

The Morning Paper

NOVEMBER 8, 2020

If you think of this a bit like mapping memory addresses to data in memory, then another parallel comes to mind: the virtual address space. replacing Paxos with Raft), or they could be shims over external storage systems. A minimal Loglet needs to provide totally ordered, durable storage via the shared log API. Reconfiguration.

Virtualization 126

Virtualization Latency Storage Systems 126

Percona

AUGUST 22, 2023

We’ll also look at the differences, as it’s important to know what architecture(s) will help you best meet your unique requirements for maximizing data assets and achieving continuous uptime. Load balancing: Traffic is distributed across multiple servers to prevent any one component from becoming overloaded.

Availability 78

Availability Hardware Open Source Database 78

SQL Server According to Bob

JANUARY 11, 2020

Microsoft, ​​ Windows, ​​ Windows NT, ​​ and Windows Server ​​ are registered trademarks of Microsoft Corporation in the United States and/or other countries. The names of actual companies and products mentioned herein may be the trademarks of their respective owners.

Servers 40

Servers Cache Database Media 40

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. This was followed by a greatly expanded second edition with some additional chapters by Rich Pettit.

Tuning 52

Tuning Benchmarking Engineering C++ 52

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. These AMD EPYC processors have a number of advantages for SQL Server workloads, as I will explain in this article. Figure 1: CPU-Z Benchmark Results for LS16v2. Azure Lsv2 Details.

Azure 42

Azure Virtualization Storage Benchmarking 42

HammerDB

DECEMBER 5, 2020

The HammerDB TPROC-C workload by design intended as CPU and memory intensive workload derived from TPC-C – so that we get to benchmark at maximum CPU performance at a much smaller database footprint. For TPC-C this meant enough available spindles to reduce I/O latency and for TPC-H enough bandwidth for data throughput.

C++ 40

C++ Benchmarking Virtualization Open Source 40

The Netflix TechBlog

MAY 21, 2019

Netflix engineers run a series of tests and benchmarks to validate the device across multiple dimensions including compatibility of the device with the Netflix SDK, device performance, audio-video playback quality, license handling, encryption and security. Likewise it has very low requirements on the initial amount of training data.

Testing 163

Testing AWS Lambda Network 163

SQL Server According to Bob

SEPTEMBER 26, 2016

When we released Always On Availability Groups in SQL Server 2012 as a new and powerful way to achieve high availability, hardware environments included NUMA machines with low-end multi-core processors and SATA and SAN drives for storage (some SSDs). As we moved towards SQL Server 2014, the pace of hardware accelerated.

Availability 40

Availability Servers Hardware Benchmarking 40

HammerDB

DECEMBER 1, 2022

In particular, after a running a test it would be ideal to have a repository where we could verify the configuration of the workload that was run, the results and any timing or transaction count data generated to bring all the log output into a central location. Jobs Configuration and Storage. HammerDB v4.6 HammerDB CLI v4.6

Virtualization 57

Virtualization C++ Storage Database 57

Percona

AUGUST 5, 2023

Partitioning is a way in which a database (MySQL in this case) splits its actual data down into separate tables but still gets treated as a single table by the SQL layer. Otherwise, the storage engine does a scatter-gather and queries ALL partitions in a UNION that is not concurrent. So, What is MySQL Partitioning? MySQL version 5.7

Strategy 40

Strategy Storage Database Best Practices 40

Scalegrid

JULY 13, 2020

The $47,500 licensing costs for Oracle Enterprise Edition is only for one CPU core, that ultimately has to be multiplied with the actual number of cores on the physical server. Oracle requires more complex ongoing administration, as all database configurations must evolve in conjunction with the data schemas and custom code.

Open Source 244

Open Source Tuning C++ Database 244

Percona

DECEMBER 20, 2018

In this post we will review the most important Linux settings to adjust for performance tuning and optimization of a MySQL database server. Ever since AMD released their EPYC CPU for servers I wanted to test it, but I did not have the opportunity until recently, when Packet.net started offering bare metal servers for a reasonable price.

Database 40

Database Tuning Performance AWS 40

Percona

AUGUST 30, 2018

Let’s examine the TPC-C Benchmark from this point of view, or more specifically its implementation in Sysbench. The illustrations below are taken from Percona Monitoring and Management (PMM) while running this benchmark. We can see the amount of data written to the disk is 2x more than the amount of data being read from the disk.

Benchmarking 47

Benchmarking Database Operating System Architecture 47

HammerDB

DECEMBER 14, 2022

linux-systemd-x86_64/data default_authentication_plugin=mysql_native_password socket=/tmp/mariadb.sock port=3306 log-error=/tmp/mariadb.log bind_address=redpoll. my.cnf --user=hammerdb 2022-12-14 12:14:05 0 [Note] bin/mysqld (server 10.10.2-MariaDB) Benchmark set to TPC-C for MariaDB. Benchmark set to TPC-C for MariaDB.

C++ 62

C++ Virtualization Database Benchmarking 62