Dynatrace

NOVEMBER 11, 2020

Dynatrace OneAgent deployment and life-cycle management are already widely considered to be industry benchmarks for reliability and efficiency. Easier rollout thanks to log storage best practices. Easier rollout thanks to log storage best practices. Dynatrace news. Advanced customization of OneAgent deployments made easy.

Best Practices 193

Best Practices Storage Java Benchmarking 193

Scalegrid

JANUARY 25, 2024

Key metrics like throughput, request latency, and memory utilization are essential for assessing Redis health, with tools like the MONITOR command and Redis-benchmark for latency and throughput analysis and MEMORY USAGE/STATS commands for evaluating memory. This plays a crucial role in supervising the replication process.

Metrics 130

Metrics Monitoring Latency Cache 130

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

HammerDB

APRIL 19, 2023

As database performance is heavily influenced by the performance of storage, network, memory, and processors, we must understand the upper limit of these key components. For storage, FIO is generally used. Benchmarking the target Two of the more popular database benchmarks for MySQL are HammerDB and sysbench. 0.42 %sys 9.52

Performance 54

Performance Benchmarking Cache Storage 54

Scalegrid

DECEMBER 6, 2023

Self-managed databases come with their own set of expenses that must be factored in – managing a database requires time and effort which often includes backup storage, patching software upgrades as well as other typical administration tasks. Advantages of DBaaS Database management with DBaaS is like being on a luxury cruise.

Database 130

Database Cloud Hardware Storage 130

Percona

MARCH 23, 2023

As datasets continue to grow in size, the amount of RAM required to store and process these datasets also increases. Storage The type of storage and disk used for database servers can have a significant impact on performance and reliability. Benchmark before you decide. Transparent huge pages (THP) disabled.

Performance 127

Performance Hardware Tuning Storage 127

Particular Software

SEPTEMBER 20, 2021

Why RPC is “faster” It’s tempting to simply write a micro-benchmark test where we issue 1000 requests to a server over HTTP and then repeat the same test with asynchronous messages. But to be fair, we also have to process the messages on the server before we can consider the messaging case to be complete. Messaging doesn’t do that.

Benchmarking 97

Benchmarking Latency Servers Systems 97

HammerDB

JUNE 27, 2022

HammerDB is a software application for database benchmarking. Databases are highly sophisticated software, and to design and run a fair benchmark workload is a complex undertaking. The Transaction Processing Performance Council (TPC) was founded to bring standards to database benchmarking, and the history of the TPC can be found here.

Benchmarking 62

Benchmarking Open Source C++ Cache 62

Percona

DECEMBER 23, 2022

I wrote this post on MyRocks because I believe it is the most interesting new MySQL storage engine to have appeared over the last few years. The use case is the TPC-C benchmark but executed not on a high-end server but on a lower-spec virtual machine that is I/O limited like for example, with AWS EBS volumes. Long term stability.

Storage 56

Storage Cache C++ Virtualization 56

The Netflix TechBlog

NOVEMBER 22, 2019

This entertaining romp through the tech stack serves as an introduction to how we think about and design systems, the Netflix approach to operational challenges, and how other organizations can apply our thought processes and technologies. In order to maintain performance, benchmarking is a vital part of our system’s lifecycle.

AWS 100

AWS Entertainment Open Source Benchmarking 100

The Netflix TechBlog

NOVEMBER 22, 2019

This entertaining romp through the tech stack serves as an introduction to how we think about and design systems, the Netflix approach to operational challenges, and how other organizations can apply our thought processes and technologies. In order to maintain performance, benchmarking is a vital part of our system’s lifecycle.

AWS 100

AWS Entertainment Open Source Benchmarking 100

Percona

APRIL 7, 2023

To illustrate this, I ran the Sysbench-TPCC synthetic benchmark against two different GCP instances running a freshly installed Percona Server for MySQL version 8.0.31 In MySQL, considering the standard storage engine, InnoDB , the data cache is called Buffer Pool. In PostgreSQL, it is called shared buffers.

Tuning 137

Tuning Cache Servers Benchmarking 137

Particular Software

OCTOBER 26, 2020

If you are already using Cosmos DB to store your business data, you no longer need to use a different storage technology to store your NServiceBus saga data. How does this compare with Azure Storage Persistence? For a scenario of 1,000 sagas, we’ve seen a 30% performance increase using Cosmos DB over Table Storage.

Azure 52

Azure Storage Benchmarking Latency 52

Percona

JUNE 22, 2023

Indexing efficiency Monitoring indexing efficiency in MySQL involves analyzing query performance, using EXPLAIN statements, utilizing performance monitoring tools, reviewing error logs, performing regular index maintenance, and benchmarking/testing. This KPI is also directly related to Query Performance and helps improve it.

Performance 106

Performance Monitoring Traffic Database 106

Percona

JULY 1, 2023

For those with applications already built on MySQL or PostgreSQL, migrating to Aurora is a straightforward process requiring minimal code changes, as it supports the same protocols, tools, and drivers. Amazon Aurora is a relational, proprietary, closed-source database engine with all that that implies. RDS MySQL is 5.5,

AWS 52

AWS Database Serverless Storage 52

The Morning Paper

AUGUST 29, 2019

use the TPC-H benchmark to assess Redshift, Redshift Spectrum, Athena, Presto, Hive, and Vertica to find out what works best and the trade-offs involved. My key takeaways as a TL;DR: Store your data in S3 Use portable data format that gives you future flexibility to process it with multiple different systems (e.g. Key findings.

Architecture 76

Architecture Cloud Storage Serverless 76

Percona

JULY 25, 2023

After the “data dictionary” (DD) engine and DD cache are initialized on a server, the Storage Engines can ask for a table definition. A node completes the SST process faster and joins the PXC cluster quickly. Benchmarks xtrabackup –prepare on backup directory of other sizes like 10K, 50K, 100K, and 250K tables.

Cache 87

Cache Benchmarking Servers Design 87

SQL Performance

DECEMBER 17, 2019

This removes the burden of purchasing and maintaining your hardware, storage and networking infrastructure, while still giving you a very familiar experience with Windows and SQL Server itself. There are also large differences in storage capacity and throughput between these extremes.

Azure 72

Azure Virtualization Servers Storage 72

HammerDB

NOVEMBER 5, 2018

This post at an entry-level discusses the options you have to improve log throughput in your benchmark environment. . A good example of how tuning is an iterative process. For MySQL the dependency is at the storage engine level and in this case for the InnoDB storage engine the parameter is self-explanatory. PostgreSQL.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Percona

MAY 1, 2023

Hardware optimization : You need to ensure that the CPU, memory, and storage components meet the performance requirements of the database workload. PostgreSQL performance optimization is an ongoing process involving monitoring, benchmarking, and adjustments to maintain high-performing PostgreSQL databases.

Tuning 52

Tuning Efficiency Database Performance 52

Percona

JANUARY 19, 2023

Compression: Compression is the process of restructuring the data by changing its encoding in order to store it in fewer bytes. It can help us to save costs on storage and backup times. MyRocks: MyRocks is a storage engine developed by Facebook and made open source. 1 mysql mysql 592K Dec 30 02:48 tb1.ibd ibd -rw-r --.

Open Source 90

Open Source Storage Database Big Data 90

Abhishek Tiwari

DECEMBER 27, 2017

In 2018, a widespread adaptation of Kubernetes for big data processing is anitcipated. faster access to external storage and data locality (I/O, bandwidth). For instance, scatter/gather pattern can be used to implement a MapReduce like batch processing architecture on top of Kubernetes. Performance. Custom schedulers.

Big Data 63

Big Data Storage Benchmarking Hardware 63

HammerDB

DECEMBER 5, 2020

The HammerDB TPROC-C workload by design intended as CPU and memory intensive workload derived from TPC-C – so that we get to benchmark at maximum CPU performance at a much smaller database footprint. more transactions than system B in the fully audited benchmark then the HammerDB result was also 1.5X I.e. if system A generated 1.5X

C++ 40

C++ Benchmarking Virtualization Open Source 40

HammerDB

DECEMBER 14, 2022

MariaDB) starting as process 4483. Benchmark set to TPC-C for MariaDB. in host REDPOLL:3306 under user ROOT in database TPCC with storage engine INNODB? Benchmark set to TPC-C for MariaDB. Vuser 2:Processing 10000000 transactions with output suppressed. [mysqld] skip-log-bin datadir=/home/hammerdb/mariadb-10.10.2-linux-systemd-x86_64/data

C++ 62

C++ Virtualization Database Benchmarking 62

The Netflix TechBlog

MAY 21, 2019

Partners across the globe leverage Netflix device certification process on a continual basis to ensure that quality products and experiences are delivered to their customers. The certification process involves the verification of partner’s implementation of features provided by the Netflix SDK.

Testing 163

Testing AWS Lambda Network 163

Percona

SEPTEMBER 1, 2023

A finely tuned database processes queries more efficiently, leading to swifter results. Inefficient query design, such as utilizing SELECT * instead of specifying necessary columns, can escalate data transfer and processing overhead. Avoid over-indexing, which can bloat storage and slow writes.

Tuning 52

Tuning Database Performance Hardware 52

Percona

JANUARY 24, 2023

This will be clearly visible in PostgreSQL performance benchmarks as a “ Sawtooth wave ” pattern observed by Vadim in his tests: As we can see, the throughput suddenly drops after every checkpoint due to heavy WAL writing and gradually picks up until the next checkpoint. But this comes with a considerable performance implication.

Database 118

Database Benchmarking Open Source Latency 118

The Morning Paper

NOVEMBER 8, 2020

That’s not just theoretical, Facebook actually did this in production while Delos was processing over 1.8 replacing Paxos with Raft), or they could be shims over external storage systems. A minimal Loglet needs to provide totally ordered, durable storage via the shared log API. billion transactions per day. The NativeLoglet.

Virtualization 126

Virtualization Latency Storage Systems 126

Percona

AUGUST 5, 2023

Otherwise, the storage engine does a scatter-gather and queries ALL partitions in a UNION that is not concurrent. This method distributes data evenly across partitions to achieve balanced storage and optimal query performance. You want to ensure that table lookups go to the correct partition or group of partitions.

Strategy 40

Strategy Storage Database Best Practices 40

Adrian Cockcroft

JUNE 21, 2022

Another big jump, but now it was my job to run benchmarks in the lab, and write white papers that explained the new products to the world, as they were launched. I was mostly coding in C, tuning FORTRAN, and when I needed to do a lot of data analysis of benchmark results used the S-PLUS statistics language, that is the predecessor to R.

Tuning 52

Tuning Benchmarking Engineering C++ 52

The Morning Paper

NOVEMBER 26, 2019

The synthesis process is quite straightforward as the expressive merge specification already describes what the result of a relational merge should be. ” The authors also implemented four large application benchmarks (TPC-C, TPC-E, RUBiS, and Twissandra) as a collection of MRDTs.

C++ 98

C++ Storage Benchmarking Efficiency 98

The Morning Paper

MAY 27, 2019

Last week we saw the benefits of rethinking memory and pointer models at the hardware level when it came to object storage and compression ( Zippads ). The process model, user-kernel interactions, dynamic linking, and memory management concerns are all in scope, and the protection spans the OS/DBMS boundary. ASPLOS’19.

C++ 61

C++ Hardware Virtualization Benchmarking 61

Smashing Magazine

SEPTEMBER 28, 2022

Every unnecessary bit of JavaScript code you bundle and serve will be more code the client has to load and process. On your first try, you can use it as a benchmark for optimizations later. Caching partially stores your data and is not used as permanent storage. Using the cache as permanent storage is an anti-pattern.

Cache 125

Cache Performance Servers Social Media 125

Percona

JUNE 22, 2023

Failover mechanisms The primary purpose of failover — the automatic process of switching from a failed or offline database server to a standby or backup server — is to ensure user access and functionality of databases without interruption, even if there is a hardware or software failure.

Availability 110

Availability Database Open Source Hardware 110

The Netflix TechBlog

NOVEMBER 22, 2019

This entertaining romp through the tech stack serves as an introduction to how we think about and design systems, the Netflix approach to operational challenges, and how other organizations can apply our thought processes and technologies. In order to maintain performance, benchmarking is a vital part of our system’s lifecycle.

AWS 37

AWS Entertainment Open Source Benchmarking 37

Scalegrid

JULY 13, 2020

of PostgreSQL users are currently in the process of migrating to the RDBMS, according to the 2019 PostgreSQL Trends Report , an astounding percentage considering this is the 4th most popular database in the world. pg_repack – reorganizes tables online to reclaim storage. In fact, PostgreSQL is so popular, 11.5%

Open Source 244

Open Source Tuning C++ Database 244

Dotcom-Montior

JUNE 16, 2020

SaaS businesses are built upon the simplicity of computing, storage, and networking they provide to their users. To achieve the overall availability to your users, you first need to identify critical business transactions they perform , such as login, add product, edit product, upload image, process orders, download reports, and so on.

Infrastructure 52

Infrastructure Monitoring Mobile Benchmarking 52