SQL Performance

DECEMBER 17, 2019

One initial, easy step to moving your SQL Server on-premises workloads to the cloud is using Azure VMs to run your SQL Server workloads in an infrastructure as a service (IaaS) scenario. You will still have to maintain your operating system, SQL Server and databases just like you would in an on-premises scenario.

Azure 72

Azure Virtualization Servers Storage 72

Percona

NOVEMBER 3, 2023

Rather than listing the concepts, function calls, etc, available in Citus, which frankly is a bit boring, I’m going to explore scaling out a database system starting with a single host. And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty.

Database 108

Database Benchmarking Latency C++ 108

Percona

MARCH 23, 2023

Hardware Memory The amount of RAM to be provisioned for database servers can vary greatly depending on the size of the database and the specific requirements of the company. Some servers may need a few GBs of RAM, while others may need hundreds of GBs or even terabytes of RAM. Benchmark before you decide.

Performance 127

Performance Hardware Tuning Storage 127

Percona

JUNE 22, 2023

As a MySQL database administrator, keeping a close eye on the performance of your MySQL server is crucial to ensure optimal database operations. However, simply deploying a monitoring tool is not enough; you need to know which Key Performance Indicators (KPIs) to monitor to gain insights into your MySQL server’s health and performance.

Performance 107

Performance Monitoring Traffic Database 107

Percona

APRIL 7, 2023

If we were to select the most important MySQL setting, if we were given a freshly installed MySQL or Percona Server for MySQL and could only tune a single MySQL variable, which one would it be? Sysbench ran on a third server, which I’ll refer to as the application server (APP).

Tuning 137

Tuning Cache Servers Benchmarking 137

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Scalegrid

DECEMBER 6, 2023

In the digital age, data management has transformed from locally hosted servers to cloud solutions. All the tedious tasks such as storage, backups, and configuration are managed by an attentive crew so that you can concentrate on making your vacation special. Make sure to read our extensive article on DBaaS Pros and Cons !

Database 130

Database Cloud Hardware Storage 130

SQL Performance

NOVEMBER 18, 2019

Migrating an on-premises SQL Server instance to an Azure Virtual Machine (VM) is a common method to migrate to Azure. IT professionals are familiar with scoping the size of VMs with regards to vCPU, memory, and storage capacity. Compute optimized – High CPU-to-memory ration, medium traffic web servers and application servers.

Azure 76

Azure Benchmarking Storage Virtualization 76

Percona

MARCH 17, 2023

PMM2 uses VictoriaMetrics (VM) as its metrics storage engine. Planning for resources of a PMM Server host instance can be tricky because the numbers can change depending on the DB instances being monitored by PMM. 25 Bytes, or you should plan storage roughly between 500 GB – one TB for a default 30 day retention period.

Monitoring 103

Monitoring Scalability Cache Database 103

SQL Performance

AUGUST 27, 2019

On August 7, 2019, AMD finally unveiled their new 7nm EPYC 7002 Series of server processors, formerly code-named "Rome" at the AMD EPYC Horizon Event in San Francisco. This is the second generation EPYC server processor that uses the same Zen 2 architecture as the AMD Ryzen 3000 Series desktop processors.

Servers 52

Servers Benchmarking Virtualization Architecture 52

SQL Server According to Bob

SEPTEMBER 26, 2016

When we released Always On Availability Groups in SQL Server 2012 as a new and powerful way to achieve high availability, hardware environments included NUMA machines with low-end multi-core processors and SATA and SAN drives for storage (some SSDs). As we moved towards SQL Server 2014, the pace of hardware accelerated.

Availability 40

Availability Servers Hardware Benchmarking 40

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Percona

JULY 25, 2023

The data is internally inconsistent because the server concurrently modifies the data files while they are being copied. The changes done by an uncommitted transaction can be flushed or written to the redo log by the server. Initializing a DD engine and the cache adds complexity and other server dependencies.

Cache 87

Cache Benchmarking Servers Design 87

Percona

DECEMBER 23, 2022

I wrote this post on MyRocks because I believe it is the most interesting new MySQL storage engine to have appeared over the last few years. The use case is the TPC-C benchmark but executed not on a high-end server but on a lower-spec virtual machine that is I/O limited like for example, with AWS EBS volumes. Conclusion.

Storage 56

Storage Cache C++ Virtualization 56

Percona

JULY 1, 2023

These may be performance, high availability, operational cost, management, capacity planning, scalability, security, monitoring, etc. Understanding DBaaS DBaaS cloud services allow users to use databases without configuring physical hardware and infrastructure or installing software. What is Amazon RDS?

AWS 52

AWS Database Serverless Storage 52

The Morning Paper

NOVEMBER 8, 2020

USENIX is a nonprofit organisation committed to making content and research freely available – both conference proceedings and the recorded presentations of their events. They needed a table store to power core control plane services, which meant strong guarantees on durability, consistency, and availability.

Virtualization 126

Virtualization Latency Storage Systems 126

Percona

JANUARY 24, 2023

This will be clearly visible in PostgreSQL performance benchmarks as a “ Sawtooth wave ” pattern observed by Vadim in his tests: As we can see, the throughput suddenly drops after every checkpoint due to heavy WAL writing and gradually picks up until the next checkpoint. But this comes with a considerable performance implication.

Database 118

Database Benchmarking Open Source Latency 118

Percona

JANUARY 19, 2023

It can help us to save costs on storage and backup times. While MySQL can handle large data sets, it is always recommended to keep only the used data in the databases, as this will make data access more efficient, and also will help to save costs on storage and backups. It is available under a paid subscription.

Open Source 91

Open Source Storage Database Big Data 91

Percona

SEPTEMBER 1, 2023

This results in expedited query execution, reduced resource utilization, and more efficient exploitation of the available hardware resources. Reduced Resource Usage Optimizing resource-intensive queries and configurations can lead to a reduced burden on your server. Indexing is another powerful technique for query optimization.

Tuning 52

Tuning Database Performance Hardware 52

Scalegrid

JULY 13, 2020

Compare PostgreSQL vs. Oracle functionality across available tools, capabilities and services. Not available. Not available. Not available. The $47,500 licensing costs for Oracle Enterprise Edition is only for one CPU core, that ultimately has to be multiplied with the actual number of cores on the physical server.

Open Source 244

Open Source Tuning C++ Database 244

HammerDB

DECEMBER 5, 2020

The HammerDB TPROC-C workload by design intended as CPU and memory intensive workload derived from TPC-C – so that we get to benchmark at maximum CPU performance at a much smaller database footprint. For TPC-C this meant enough available spindles to reduce I/O latency and for TPC-H enough bandwidth for data throughput.

C++ 40

C++ Benchmarking Virtualization Open Source 40

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. These VMs are not available in all regions, so you will want to check the availability in the Azure region that you are interested in using. AMD EPYC 7551 Details.

Azure 42

Azure Virtualization Storage Benchmarking 42

Adrian Cockcroft

JUNE 21, 2022

I became the Sun UK local specialist in performance and hardware, and as Sun transitioned from a desktop workstation company to sell high end multiprocessor servers I was helping customers find and fix scalability problems. At one point we had two conflicting high availability products from different teams, who weren’t cooperating.

Tuning 52

Tuning Benchmarking Engineering C++ 52

Percona

MAY 1, 2023

Hardware optimization : You need to ensure that the CPU, memory, and storage components meet the performance requirements of the database workload. PostgreSQL performance optimization is an ongoing process involving monitoring, benchmarking, and adjustments to maintain high-performing PostgreSQL databases.

Tuning 52

Tuning Efficiency Database Performance 52

SQL Server According to Bob

JANUARY 11, 2020

Microsoft SQL Server I/O Basics Author: ​​ Bob Dorr, Microsoft SQL Server Escalation Published: ​​ December, 2004 SUMMARY: ​​ Learn the I/O requirements for Microsoft SQL Server database file operations. This will help you increase system performance and avoid I/O environment errors.

Servers 40

Servers Cache Media Hardware 40

The Netflix TechBlog

MAY 21, 2019

Netflix engineers run a series of tests and benchmarks to validate the device across multiple dimensions including compatibility of the device with the Netflix SDK, device performance, audio-video playback quality, license handling, encryption and security. The library is available in the artifactory repository for easy installation.

Testing 163

Testing AWS Lambda Network 163

SQL Server According to Bob

JANUARY 11, 2020

Microsoft, ​​ Windows, ​​ Windows NT, ​​ and Windows Server ​​ are registered trademarks of Microsoft Corporation in the United States and/or other countries. The names of actual companies and products mentioned herein may be the trademarks of their respective owners.

Servers 40

Servers Cache Database Media 40

Percona

DECEMBER 20, 2018

In this post we will review the most important Linux settings to adjust for performance tuning and optimization of a MySQL database server. Ever since AMD released their EPYC CPU for servers I wanted to test it, but I did not have the opportunity until recently, when Packet.net started offering bare metal servers for a reasonable price.

Database 40

Database Tuning Performance AWS 40

CSS - Tricks

JUNE 5, 2020

The HBO sitcom Silicon Valley hilariously followed Pied Piper, a team of developers with startup dreams to create a compression algorithm so powerful that high-quality streaming and file storage concerns would become a thing of the past. In my benchmarks, Brotli:11 takes several hundred milliseconds to compress a single minified jQuery file.

Cache 79

Cache Website Servers Open Source 79

HammerDB

DECEMBER 14, 2022

my.cnf --user=hammerdb 2022-12-14 12:14:05 0 [Note] bin/mysqld (server 10.10.2-MariaDB) The scripts are available in both Python and Tcl formats. Benchmark set to TPC-C for MariaDB. in host REDPOLL:3306 under user ROOT in database TPCC with storage engine INNODB? Benchmark set to TPC-C for MariaDB. TMP/hammer.DB

C++ 62

C++ Virtualization Database Benchmarking 62

Percona

AUGUST 5, 2023

Otherwise, the storage engine does a scatter-gather and queries ALL partitions in a UNION that is not concurrent. This method distributes data evenly across partitions to achieve balanced storage and optimal query performance. You want to ensure that table lookups go to the correct partition or group of partitions.

Strategy 40

Strategy Storage Database Best Practices 40

HammerDB

OCTOBER 12, 2018

As is also the case this limitation is at the database level (especially the storage engine) rather than the hardware level. InnoDB is the storage engine that will deliver the best OLTP throughput and should be chosen for this test. . GHz available cpufreq governors: performance powersave . HammerDB difference from Sysbench.

Best Practices 40

Best Practices Scalability Performance C++ 40

Alex Russell

OCTOBER 22, 2017

Budgets are scaled to a benchmark network & device. Late-loading JavaScript can cause “server-side rendered” pages to fail in infuriating ways. The server sends it as a stream of bytes and when the browser encounters each of the sub-resources referenced in the document, it requests them. Global Ground-Truth.

Performance 68

Performance Benchmarking Network Mobile 68

Alex Russell

MARCH 6, 2021

A then-representative $200USD device had 4-8 slow (in-order, low-cache) cores, ~2GiB of RAM, and relatively slow MLC NAND flash storage. Modern network performance and availability. Using a global ASP as a benchmark can further mislead thanks to the distorting effect of ultra-high-end prices rising while shipment volumes stagnate.

Performance 124

Performance Network Cache Metrics 124

Smashing Magazine

JANUARY 11, 2021

In the end, it’s not the load events or server response times that define the experience, but the perception of how snappy the interface feels. It used to provide an insight into how quickly the server outputs any data. This knowledge will give you the best optimization target for ongoing efforts. What does it mean?

Performance 145

Performance Cache Media Metrics 145

ScaleOut Software

MAY 15, 2014

For example, the IMDG must be able to efficiently create millions of objects in each server to make use of its huge storage capacity. In a recent customer engagement, the application needed to load 10M objects into each server of the IMDG’s cluster to make full use of high-end servers with 60GB memory capacity.

Cache 40

Cache Servers Network Design 40

Smashing Magazine

JANUARY 6, 2020

Is it worth exploring tree-shaking, scope hoisting, code-splitting, and all the fancy loading patterns with intersection observer, server push, clients hints, HTTP/2, service workers and — oh my — edge workers? It used to provide an insight into how quickly the server outputs any data. What does it mean?

Performance 145

Performance Cache Network Metrics 145