HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For example, if you are buying the latest Amazon memory-optimized EC2 instance (R7iz), the AWS page ( [link] ) tells us the following: Up to 3.9 4.22 %usr 38.40

Performance 54

Performance Benchmarking Cache Storage 54

Scalegrid

JANUARY 25, 2024

Key metrics like throughput, request latency, and memory utilization are essential for assessing Redis health, with tools like the MONITOR command and Redis-benchmark for latency and throughput analysis and MEMORY USAGE/STATS commands for evaluating memory. It depends upon your application workload and its business logic.

Metrics 130

Metrics Monitoring Latency Cache 130

The Netflix TechBlog

OCTOBER 19, 2020

a Netflix member via Twitter This is an example of a question our on-call engineers need to answer to help resolve a member issue?—?which Our distributed tracing infrastructure is grouped into three sections: tracer library instrumentation, stream processing, and storage. Storage: don’t break the bank!

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

The Netflix TechBlog

MARCH 14, 2023

An example of using Machine Learning to find shots of Eleven in Stranger Things and surfacing the results in studio application for the consumption of Netflix video editors. Here is an example of the desired output when the user searches for “red race car” across the entire content library. a close-up shot).

Media 291

Media Innovation Energy Architecture 291

SQL Performance

NOVEMBER 18, 2019

IT professionals are familiar with scoping the size of VMs with regards to vCPU, memory, and storage capacity. Storage optimized – High disk throughput and IO. and the overall size will determine the amount of temporary storage available. Premium storage support. VM Types and Sizes. VM Image Options. Generation.

Azure 76

Azure Benchmarking Storage Virtualization 76

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. In order to maintain performance, benchmarking is a vital part of our system’s lifecycle. Thursday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 209 File system as a service at Netflix Kishore Kasi , Senior Software Engineer Abstract : As Netflix grows in original content creation, its need for storage is also increasing at a rapid pace. In order to maintain performance, benchmarking is a vital part of our system’s lifecycle. Thursday?—?December

AWS 100

AWS Entertainment Open Source Benchmarking 100

Percona

MARCH 23, 2023

Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability. Each of them has its own limits and advantages: for example, XFS is fast in deleting large files, while EXT4 can provide better performance on fast SSD drives, and ZFS on Linux has progressed a lot.

Performance 123

Performance Hardware Tuning Storage 123

Percona

JUNE 22, 2023

Let’s dive in and learn how (and what) to effectively monitor MySQL performance, along with examples from PMM, by understanding the critical KPIs to watch for. This is not an exhaustive list but an example of what we can watch for. This KPI is also directly related to Query Performance and helps improve it.

Performance 102

Performance Monitoring Traffic Database 102

Percona

DECEMBER 23, 2022

I wrote this post on MyRocks because I believe it is the most interesting new MySQL storage engine to have appeared over the last few years. The use case is the TPC-C benchmark but executed not on a high-end server but on a lower-spec virtual machine that is I/O limited like for example, with AWS EBS volumes. Conclusion.

Storage 55

Storage Cache C++ Virtualization 55

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Percona

MARCH 17, 2023

PMM2 uses VictoriaMetrics (VM) as its metrics storage engine. Please note that the focus of these tests was around standard metrics gathering and display, we’ll use a future blog post to benchmark some of the more intensive query analytics (QAN) performance numbers.

Monitoring 95

Monitoring Scalability Cache Database 95

The Netflix TechBlog

SEPTEMBER 2, 2020

Example call graph in Edgar In some cases, the question we’re answering is, “What’s happening right now??” This difference has substantial technological implications, from the classification of what’s interesting to transport to cost-effective storage (keep an eye out for later Netflix Tech Blog posts addressing these topics).

Latency 296

Latency Transportation Engineering Traffic 296

Percona

JULY 25, 2023

They are then applied (for example, writing old values back again) to the pages again and written to disk. After the “data dictionary” (DD) engine and DD cache are initialized on a server, the Storage Engines can ask for a table definition. Let’s take a look at the example table. CREATE TABLE test.t1(a

Cache 83

Cache Benchmarking Servers Design 83

SQL Performance

DECEMBER 17, 2019

This removes the burden of purchasing and maintaining your hardware, storage and networking infrastructure, while still giving you a very familiar experience with Windows and SQL Server itself. There are also large differences in storage capacity and throughput between these extremes.

Azure 72

Azure Virtualization Servers Storage 72

HammerDB

NOVEMBER 5, 2018

This post at an entry-level discusses the options you have to improve log throughput in your benchmark environment. . The first example shows a data load, the second a TPC-C based workload with 5 virtual users and the 2nd example with 10 virtual users. A good example of how tuning is an iterative process. PostgreSQL.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Percona

JULY 1, 2023

Multi-Availability Zone (AZ) Deployment Aurora’s Multi-Availability Zone (AZ) deployment offers remarkably high availability and fault tolerance by automatically replicating data across multiple availability zones using its distributed storage architecture to eliminate single points of failure. RDS MySQL is 5.5,

AWS 52

AWS Database Serverless Storage 52

Percona

JANUARY 19, 2023

Example (using the employee sample DB ): Suppose we have the following schema: db1 employees> show create table employeesG 1. Example: Creating four simple tables to store strings but using different data types: db1 test> CREATE TABLE tb1 (id int auto_increment primary key, test_text char(200)); Query OK, 0 rows affected (0.11

Open Source 85

Open Source Storage Database Big Data 85

Percona

APRIL 7, 2023

To illustrate this, I ran the Sysbench-TPCC synthetic benchmark against two different GCP instances running a freshly installed Percona Server for MySQL version 8.0.31 In MySQL, considering the standard storage engine, InnoDB , the data cache is called Buffer Pool. In PostgreSQL, it is called shared buffers.

Tuning 133

Tuning Cache Servers Benchmarking 133

The Morning Paper

NOVEMBER 8, 2020

For example, Loglets might be instances of the same ordering protocol, but with different parameters, or they could be entirely different log implementations (e.g. replacing Paxos with Raft), or they could be shims over external storage systems. A minimal Loglet needs to provide totally ordered, durable storage via the shared log API.

Virtualization 126

Virtualization Latency Storage Systems 126

The Morning Paper

NOVEMBER 26, 2019

But using an example of a pair data type holding pairs of integers, the authors show that what we’ve been doing so far isn’t quite good enough. The pair example demonstrates the need and opportunity to make merges compositional. In the pair of counters example, we could use e.g. let R_pair (x,y) = {(1,x), (2,y)}.

C++ 98

C++ Storage Benchmarking Efficiency 98

HammerDB

DECEMBER 1, 2022

Jobs Configuration and Storage. The base configuration for the jobs storage can be found in the generic.xml file in the commandline section. <commandline> For example on Windows an example of opening a new database. For example, we will run the following script to build a TPROC-C schema. HammerDB CLI v4.6

Virtualization 57

Virtualization C++ Storage Database 57

n0derunner

SEPTEMBER 17, 2018

Creating a HCI benchmark to simulate multi-tennent workloads. As with traditional storage, applications are writing to a shared storage environment which is necessary to support VM movement. As with traditional storage, applications are writing to a shared storage environment which is necessary to support VM movement.

Performance Testing 40

Performance Testing Benchmarking Testing Performance 40

HammerDB

DECEMBER 5, 2020

For example HammerDB has not used tpmC terminology to report TPC-C based metrics instead using TPM and NOPM nomenclature. The HammerDB TPROC-C workload by design intended as CPU and memory intensive workload derived from TPC-C – so that we get to benchmark at maximum CPU performance at a much smaller database footprint.

C++ 40

C++ Benchmarking Virtualization Open Source 40

Percona

JANUARY 24, 2023

For example, MySQL/InnoDB deals with this problem using a Doublewrite buffer from where a copy of the non-corrupt page can be obtained during the recovery. Lz4 is a good example. If a datafile with such torn page exists, PostgreSQL loses the consistency of the page. PostgreSQL’s approach to the problem is slightly different.

Database 114

Database Benchmarking Open Source Latency 114

HammerDB

DECEMBER 14, 2022

This image includes example scripts to build schemas and test your databases with a single command. In this post, we will show an example of using Docker to deploy the HammerDB command line and test a database with minimal effort. Benchmark set to TPC-C for MariaDB. Benchmark set to TPC-C for MariaDB. TMP/hammer.DB

C++ 62

C++ Virtualization Database Benchmarking 62

Smashing Magazine

SEPTEMBER 28, 2022

On your first try, you can use it as a benchmark for optimizations later. Jamstack files usually use Markdown before being compiled to HTML, for example: author: Agustinus Theodorus title: ‘Title’ description: Description. Caching partially stores your data and is not used as permanent storage. Hello World.

Cache 125

Cache Performance Servers Social Media 125

Percona

AUGUST 5, 2023

Otherwise, the storage engine does a scatter-gather and queries ALL partitions in a UNION that is not concurrent. This method distributes data evenly across partitions to achieve balanced storage and optimal query performance. You want to ensure that table lookups go to the correct partition or group of partitions.

Strategy 40

Strategy Storage Database Best Practices 40

Abhishek Tiwari

DECEMBER 27, 2017

faster access to external storage and data locality (I/O, bandwidth). A recent performance benchmark completed by Intel and BlueData using the BigBench benchmarking kit has shown that the performance ratios for container-based Hadoop workloads on BlueData EPIC are equal to and in some cases, better than bare-metal Hadoop [7].

Big Data 63

Big Data Storage Benchmarking Hardware 63

SQL Performance

APRIL 8, 2019

Back on December 5, 2017, Microsoft announced that they were using AMD EPYC 7551 processors in their storage-optimized Lv2-Series virtual machines. The pricing details for the East US region are here , as an example. I wrote about using CPU-Z to benchmark the Intel Xeon E5-2673 v3 processor in an Azure VM in this article.

Azure 42

Azure Virtualization Storage Benchmarking 42

n0derunner

MARCH 13, 2020

Why do we tend to use 1MB IO sizes for throughput benchmarking? To achieve the maximum throughput on a storage device, we will usually use a large IO size to maximize the amount of data is transferred per IO request. For historical reasons, many storage testers will use a 1MB IO size for sequential testing. First things First.

Benchmarking 45

Benchmarking Storage Testing Performance 45

SQL Performance

AUGUST 27, 2019

Figure 1 shows an example from AMD comparing a two-socket server with two Intel Xeon Gold 6262V processors to a one-socket server with one AMD EPYC 7702P processor. Figure 1: AMD Example of Two-socket vs. One-socket Server. AMD Rome Second Generation EPYC Review: 2x 64-core Benchmarked. This idea is not unique to AMD.

Servers 52

Servers Benchmarking Virtualization Architecture 52

Percona

JUNE 22, 2023

For example, in a server cluster, multiple servers are used to host the same application so that if one server fails, the application can continue to run on the other servers. For example, an RPO of 1 hour means that an organization can tolerate a maximum data loss of 1 hour’s worth of data.

Availability 104

Availability Database Open Source Hardware 104

The Morning Paper

SEPTEMBER 15, 2019

For example, a contract that sends a reward amount of tokens to a user based on that user’s average balance per day over some period. For example, suppose the read set is and the write set is. Here’s an example that marks an address as blacklisted if one of its last 5 transactions is with a blacklisted address.

Blockchain 55

Blockchain Efficiency Systems Storage 55

Percona

AUGUST 30, 2018

Let’s examine the TPC-C Benchmark from this point of view, or more specifically its implementation in Sysbench. The illustrations below are taken from Percona Monitoring and Management (PMM) while running this benchmark. Analyzing read/write workload by counts. Analyzing Read/Write Workload by Response Time.

Benchmarking 46

Benchmarking Database Operating System Architecture 46

Percona

SEPTEMBER 1, 2023

Inadequate CPU, memory, or storage can lead to bottlenecks and performance degradation, so remedying these issues involves upgrading hardware or optimizing resource utilization through query and server configuration adjustments. Avoid over-indexing, which can bloat storage and slow writes. This does not apply to read (SELECT) traffic.

Tuning 52

Tuning Database Performance Hardware 52