Scalegrid

JANUARY 25, 2024

Key Takeaways Critical performance indicators such as latency, CPU usage, memory utilization, hit rate, and number of connected clients/slaves/evictions must be monitored to maintain Redis’s high throughput and low latency capabilities. It can achieve impressive performance, handling up to 50 million operations per second.

Metrics 130

Metrics Monitoring Latency Cache 130

Percona

NOVEMBER 3, 2023

Leveraging pgbench , which is a benchmarking utility that comes bundled with PostgreSQL, I will put the cluster through its paces by executing a series of DML operations. And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty.

Database 103

Database Benchmarking Latency C++ 103

Scalegrid

OCTOBER 24, 2019

As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. MySQL on AWS Performance Test. MySQL Performance Benchmark Configuration. Amazon RDS. Instance Type.

AWS 183

AWS Latency Performance Benchmarking 183

Percona

DECEMBER 11, 2023

DLVs are particularly advantageous for databases with large allocated storage, high I/O per second (IOPS) requirements, or latency-sensitive workloads. We performed a standard benchmarking test using the sysbench tool to compare the performance of a DLV instance vs a standard RDS MySQL instance, as shared in the following section.

AWS 95

AWS Benchmarking Performance Traffic 95

Percona

DECEMBER 26, 2023

Although the default configuration simulates loading based loosely upon TPC-B, it is nevertheless easy to test other use cases by writing one’s own transaction script files. A script executing a benchmarking run: #!/bin/bash tps, lat 11.718 ms stddev 3.951 progress: 4440.0 tps, lat 11.075 ms stddev 3.519 progress: 4445.0

Benchmarking 120

Benchmarking Metrics C++ Database 120

Brendan Gregg

JUNE 30, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 54

Benchmarking Latency Cache Network 54

Scalegrid

JULY 29, 2020

Performance Testing. So, we pitted the two connection poolers head-to-head, using the standard pgbench tool, to see which one provides better transactions per second throughput through a benchmark test. For good measure, we ran the same tests without a connection pooler too. Testing Conditions. Pgpool-II (on box).

Benchmarking 246

Benchmarking Database Performance Testing Availability 246

Dynatrace

MAY 5, 2021

Quality gates are benchmarks in the software delivery lifecycle that define specific, measurable, and achievable success criteria a service must meet before moving to the next phase of the software delivery pipeline. For example, improving latency by as little as 0.1 latency is the number one reason consumers abandon mobile sites.

Benchmarking 182

Benchmarking Latency Speed Software 182

John McCalpin

APRIL 25, 2023

I have a lot of historical data using my ReadOnly benchmark (as described in some of the earliest entries in this blog [link] A read-only access pattern removes the need to understand and explain the many complexities associated with the “streaming stores” typically used in the STREAM benchmark (e.g., Stay tuned!

Benchmarking 97

Benchmarking Cache Latency Tuning 97

HammerDB

OCTOBER 18, 2019

HammerDB doesn’t publish competitive database benchmarks, instead we always encourage people to be better informed by running their own. So over at Phoronix some database benchmarks were published showing PostgreSQL 12 Performance With AMD EPYC 7742 vs. Intel Xeon Platinum 8280 Benchmarks . uname -a Linux ubuntu19 5.3.0-rc3-custom

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Brendan Gregg

JUNE 29, 2018

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 40

Benchmarking Latency Cache Network 40

Dynatrace

JUNE 27, 2022

These development and testing practices ensure the performance of critical applications and resources to deliver loyalty-building user experiences. Because pre-production environments are used for testing before an application is released to end users, teams have no access to real-user data. What is synthetic monitoring?

Best Practices 175

Best Practices Monitoring Wireless Traffic 175

John McCalpin

APRIL 2, 2020

To show that I can criticize my own work as well, here I show that sustained memory bandwidth (using an approximation to the STREAM Benchmark ) is also inadequate as a single figure of metric. (It Building separate models for each of the benchmarks was required to get the correct asymptotic properties.

Benchmarking 59

Benchmarking Performance Latency Architecture 59

Scalegrid

NOVEMBER 25, 2019

ScyllaDB offers significantly lower latency which allows you to process a high volume of data with minimal delay. In fact, according to ScyllaDB’s performance benchmark report, their 99.9 percentile latency is up to 11X better than Cassandra on AWS EC2 bare metal. So this type of performance has to come at a cost, right?

Big Data 187

Big Data Database Open Source Azure 187

Particular Software

SEPTEMBER 20, 2021

Some will claim that any type of RPC communication ends up being faster (meaning it has lower latency) than any equivalent invocation using asynchronous messaging. If you did such a benchmark, here’s an incomplete picture you might end up with: Graph of microbenchmark showing RPC is faster than messaging. Messaging doesn’t do that.

Benchmarking 97

Benchmarking Latency Servers Systems 97

Percona

APRIL 7, 2023

To illustrate this, I ran the Sysbench-TPCC synthetic benchmark against two different GCP instances running a freshly installed Percona Server for MySQL version 8.0.31 This explains, in part , how PostgreSQL performed better out of the box for this test workload. The throughput didn’t double but increased by 57%.

Tuning 133

Tuning Cache Servers Benchmarking 133

n0derunner

SEPTEMBER 17, 2018

Creating a HCI benchmark to simulate multi-tennent workloads. In such a case we have a Bandwidth heavy workload profile (reporting) sharing with a Latency Sensitive workload (transactional). We supply a pre-configured scenario which we call the DB Colocation test. Time based benchmark actions.

Performance Testing 40

Performance Testing Benchmarking Testing Performance 40

The Netflix TechBlog

OCTOBER 19, 2020

If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls. Using simple lookup indices in Cassandra gives us the ability to maintain acceptable read latencies while doing heavy writes.

Infrastructure 233

Infrastructure Transportation Storage Open Source 233

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. There's also a test and println() in the loop to, hopefully, convince the compiler not to optimize-out an otherwise empty loop. This will slow this test a little.) Trying it out: centos$ time java TimeBench.

Speed 126

Speed Java AWS Virtualization 126

Percona

MARCH 20, 2023

micro) The tests We will have very simple test cases. The second test will define how well the increasing load is served inside the previously identified range. Let us take a look also the latency: Here the situation starts to be a little bit more complicated. For documentation, the sysbench commands are: Test1 sysbench./src/lua/windmills/oltp_read.lua

Games 119

Games Latency Traffic Cache 119

KeyCDN

AUGUST 15, 2019

Web performance is a broad subject, and you’ll find no shortage of performance testing tips and tutorials all over the web. Before you begin tuning your website or application, you must first figure out which metrics matter most to your users and establish some achievable benchmarks. What is Performance Testing?

Testing Tools 55

Testing Tools Best Practices Performance Testing Testing 55

Percona

JUNE 22, 2023

Indexing efficiency Monitoring indexing efficiency in MySQL involves analyzing query performance, using EXPLAIN statements, utilizing performance monitoring tools, reviewing error logs, performing regular index maintenance, and benchmarking/testing. This KPI is also directly related to Query Performance and helps improve it.

Performance 103

Performance Monitoring Traffic Database 103

HammerDB

NOVEMBER 5, 2018

If you are new to running Oracle, SQL Server, MySQL and PostgreSQL TPC-C workloads with HammerDB and have needed to investigate I/O performance the chances are that you have experienced waits on writing to the Redo, Transaction Log or WAL depending on the database you are testing. SQL> alter system flush buffer_cache; System altered.

Benchmarking 40

Benchmarking Database C++ Virtualization 40

Percona

JANUARY 24, 2023

This will be clearly visible in PostgreSQL performance benchmarks as a “ Sawtooth wave ” pattern observed by Vadim in his tests: As we can see, the throughput suddenly drops after every checkpoint due to heavy WAL writing and gradually picks up until the next checkpoint. I couldn’t see any adverse effect on the TPS on quick tests.

Database 115

Database Benchmarking Open Source Latency 115

High Scalability

OCTOBER 29, 2019

As organizations continue to migrate to the cloud, it’s important to get in front of performance issues, such as high latency, low throughput, and replication lag with higher distances between your users and cloud infrastructure. AWS is the #1 cloud provider for open-source database hosting, and the go-to cloud for MySQL deployments.

AWS 133

AWS Latency Performance Open Source 133

The Morning Paper

AUGUST 29, 2019

use the TPC-H benchmark to assess Redshift, Redshift Spectrum, Athena, Presto, Hive, and Vertica to find out what works best and the trade-offs involved. As it is infeasible to test every OLAP system runnable on AWS, we chose widely-used systems that represented a variety of architectures and cost models. Key findings.

Architecture 76

Architecture Cloud Storage Serverless 76

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. There's also a test and println() in the loop to, hopefully, convince the compiler not to optimize-out an otherwise empty loop. This will slow this test a little.) Running this on the two systems saw similar results.

Speed 52

Speed Java AWS Virtualization 52

Speed Curve

MAY 1, 2023

You can then configure your monitoring tools to send you alerts – or even break the build, if you're testing in your staging environment – when your budgets are violated. INP logs the latency of all interactions throughout the entire page lifecycle. What should a performance budget look like?

Performance 98

Performance Metrics Media Google 98

HammerDB

DECEMBER 5, 2020

The HammerDB TPROC-C workload by design intended as CPU and memory intensive workload derived from TPC-C – so that we get to benchmark at maximum CPU performance at a much smaller database footprint. For TPC-C this meant enough available spindles to reduce I/O latency and for TPC-H enough bandwidth for data throughput.

C++ 40

C++ Benchmarking Virtualization Open Source 40

Alex Russell

JANUARY 30, 2024

Doing a good job in an uneven network environment requires thinking about availability and engineering for resilience and a lightweight footprint — always better to avoid testing the radio gods than it is spending weeks or months appeasing them after the damage is done. You'll have to read on for what it is! 30% of worldwide volume."

Performance 90

Performance Network Mobile Speed 90

Percona

MARCH 23, 2023

Nowadays, solid-state drives (SSDs) or non-volatile memory express (NVMe) drives are preferred over traditional hard disk drives (HDDs) for database servers due to their faster read and write speeds, lower latency, and improved reliability. Benchmark before you decide. Transparent huge pages (THP) disabled.

Performance 123

Performance Hardware Tuning Storage 123

Rigor

DECEMBER 19, 2019

Test at Every Stage of Development. Synthetic monitoring can be used to test websites and web applications in pre-production, while real user monitoring can only be used in production. AB Test the Performance Impact of Third Parties. AB Test the Performance Impact of Third Parties. Benchmark Against Competitors.

Monitoring 40

Monitoring Benchmarking Website Traffic 40

Alex Russell

MAY 9, 2022

This is a complex topic, but to borrow from a recent post , web performance expands access to information and services by reducing latency and variance across interactions in a session, with a particular focus on the tail of the distribution (P75+). Consistent performance matters just as much as low average latency.

Performance 86

Performance Latency Metrics Engineering 86

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. There's also a test and println() in the loop to, hopefully, convince the compiler not to optimize-out an otherwise empty loop. This will slow this test a little.) include <sys/time.h>

Speed 40

Speed Java AWS Virtualization 40

Alex Russell

MARCH 6, 2021

Using a global ASP as a benchmark can further mislead thanks to the distorting effect of ultra-high-end prices rising while shipment volumes stagnate. Sadly, data on latency is harder to get, even from Google's perch, so progress there is somewhat more difficult to judge. Today, either method returns a similar answer.

Performance 124

Performance Network Cache Metrics 124

IO River

NOVEMBER 15, 2023

Let's break down this Security Flywheel into its core components: ‍Research, Close Breaches, and Test. But hold your horses—before switching them to "block" mode, it's crucial to test them extensively. After you've researched, closed breaches, and tested, you start all over again. It's an ongoing, iterative process.

Traffic 52

Traffic Network Logistics Architecture 52

KeyCDN

JUNE 20, 2019

eCommerce Conversion Rate Benchmarks First off, we’ll start with some benchmarks. Online users are becoming less and less patient meaning you as an eCommerce store owner need to implement methods for reducing latency and speeding up your website. This reduces latency and speeds up your website.

Ecommerce 41

Ecommerce Speed Website Mobile 41