Brendan Gregg

JUNE 30, 2018

A co-worker introduced me to Craig Hanson and Pat Crain's performance mantras, which neatly summarize much of what we do in performance analysis and tuning. These have inspired me to summarize another performance activity: evaluating benchmark accuracy. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 54

Benchmarking Latency Cache Network 54

The Morning Paper

MARCH 10, 2020

Characterizing, modeling, and benchmarking RocksDB key-value workloads at Facebook , Cao et al., Or in the case of key-value stores, what you benchmark. So if you want to design a system that will offer good real-world performance, it’s really useful to have benchmarks that accurately represent real-world workloads.

Benchmarking 59

Benchmarking Storage Cache Latency 59

Percona

APRIL 7, 2023

If we were to select the most important MySQL setting, if we were given a freshly installed MySQL or Percona Server for MySQL and could only tune a single MySQL variable, which one would it be? To be fair, that is also true with PostgreSQL; it hasn’t been tuned either, and it, too, can also perform much better.

Tuning 137

Tuning Cache Servers Benchmarking 137

John McCalpin

APRIL 25, 2023

I have a lot of historical data using my ReadOnly benchmark (as described in some of the earliest entries in this blog [link] A read-only access pattern removes the need to understand and explain the many complexities associated with the “streaming stores” typically used in the STREAM benchmark (e.g., Stay tuned!

Benchmarking 97

Benchmarking Cache Latency Tuning 97

Brendan Gregg

JUNE 29, 2018

A co-worker introduced me to Craig Hanson and Pat Crain's performance mantras, which neatly summarize much of what we do in performance analysis and tuning. These have inspired me to summarize another performance activity: evaluating benchmark accuracy. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Benchmarking 40

Benchmarking Latency Cache Network 40

Percona

NOVEMBER 3, 2023

Leveraging pgbench , which is a benchmarking utility that comes bundled with PostgreSQL, I will put the cluster through its paces by executing a series of DML operations. And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty.

Database 109

Database Benchmarking Latency C++ 109

HammerDB

OCTOBER 18, 2019

HammerDB doesn’t publish competitive database benchmarks, instead we always encourage people to be better informed by running their own. So over at Phoronix some database benchmarks were published showing PostgreSQL 12 Performance With AMD EPYC 7742 vs. Intel Xeon Platinum 8280 Benchmarks .

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Scalegrid

JANUARY 25, 2024

Key metrics like throughput, request latency, and memory utilization are essential for assessing Redis health, with tools like the MONITOR command and Redis-benchmark for latency and throughput analysis and MEMORY USAGE/STATS commands for evaluating memory. It depends upon your application workload and its business logic.

Metrics 130

Metrics Monitoring Latency Cache 130

HammerDB

JANUARY 5, 2019

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

Benchmarking 40

Benchmarking Database Social Media Scalability 40

Brendan Gregg

MARCH 8, 2020

Systems performance is an effective discipline for performance analysis and tuning, and can help you find performance wins for your applications and the kernel. However, most of us are not performance or kernel engineers, and have limited time to study this topic.

Systems 144

Systems Performance Benchmarking Tuning 144

HammerDB

APRIL 19, 2023

GHz 4th Generation Intel Xeon Scalable processors (code-named Sapphire Rapids) Up to 20% higher compute performance than z1d instances Up to 50 Gbps of networking speed Up to 40 Gbps of bandwidth to the Amazon Elastic Block Store (EBS) We can also verify these capabilities by running some simple benchmarks on the different subsystems.

Benchmarking 54

Benchmarking Performance Cache Storage 54

Dynatrace

MAY 5, 2021

Quality gates are benchmarks in the software delivery lifecycle that define specific, measurable, and achievable success criteria a service must meet before moving to the next phase of the software delivery pipeline. Enforcing benchmarks in real time. What are quality gates? How Intuit puts Dynatrace to work.

Benchmarking 183

Benchmarking Latency Speed Software 183

Percona

JANUARY 2, 2024

We decided to run a few benchmarks to understand how the thread pool affects long-running transactions. This server is not intended to be a perfectly tuned one but just a baseline to compare the behavior under different concurrency configurations. For this reason, I’ve set up a server with the following specs: r6a.2xlarge

Benchmarking 89

Benchmarking Servers Tuning Metrics 89

Dynatrace

FEBRUARY 10, 2022

A perfect OWASP benchmark score for injection attacks – 100% accuracy and zero false positives – impressively proves the precision of our approach. We will further enhance the detection and blocking capability to cover additional attack types, so stay tuned for updates!

Traffic 234

Traffic Benchmarking Innovation Tuning 234

HammerDB

OCTOBER 18, 2018

It is also clear that most significant wait event is “log file sync” and therefore tuning should focus on the redo log performance. In this example a test with 2 minute rampup and 5 minute test time can be seen. The user CPU is highlighted in green and the aim for maximum performance is for the top event to be CPU. .

Benchmarking 40

Benchmarking Monitoring Performance C++ 40

The Morning Paper

NOVEMBER 3, 2019

Perhaps the most interesting lesson/reminder is this: it takes a lot of effort to tune a Linux kernel. Google’s data center kernel is carefully performance tuned for their workloads. A micro-benchmark suite, LEBench was then built around tee system calls responsible for most of the time spent in the kernel. Headline results.

Benchmarking 108

Benchmarking Performance Tuning Hardware 108

Dynatrace

OCTOBER 2, 2023

Use SLAs, SLOs, and SLIs as performance benchmarks for newly migrated microservices. With real-time observability, teams can easily plan their migration and fine-tune performance as they migrate microservices. Repeat this process throughout the different environments before development, staging, release, and production.

Architecture 232

Architecture Artificial Intelligence Open Source Cloud 232

Percona

MARCH 23, 2023

Benchmark before you decide. If you see concurrency issues, you can tune this variable. Application tuning for InnoDB Make sure your application is prepared to handle deadlocks that may happen. For database servers, we usually recommend our clients have: Jemalloc installed and enabled for MySQL. I hope this helps!

Performance 128

Performance Hardware Storage Tuning 128

Adrian Cockcroft

JUNE 21, 2022

Another big jump, but now it was my job to run benchmarks in the lab, and write white papers that explained the new products to the world, as they were launched. I was mostly coding in C, tuning FORTRAN, and when I needed to do a lot of data analysis of benchmark results used the S-PLUS statistics language, that is the predecessor to R.

Tuning 52

Tuning Benchmarking Engineering Best Practices 52

n0derunner

JULY 23, 2019

In this video I migrate a Postgres DB running PGbench benchmark. The variation in the transaction rate is due to the benchmark itself, the transaction rate is not expected to be uniform. The Postgres DB is totally un-tuned and contains purely default settings. The DB is running on a Host which is CPU constrained.

Benchmarking 76

Benchmarking Tuning Storage Cache 76

Dynatrace

JULY 16, 2019

Synthetic clickpath monitors are a great way to automatically monitor and benchmark business-critical workflows 24/7. Soon, HTTP monitors will also be able to execute JavaScript, so stay tuned! Dynatrace news. Some common examples of such business-critical workflows include: Sign-up processes. Checking out of a retail site.

Monitoring 163

Monitoring Retail Benchmarking Tuning 163

Percona

OCTOBER 12, 2023

Manual flame graphs collection Although the tool is excellent and automatically provides flame graphs, we don’t have much control over tuning the selected profiler. A simple sysbench benchmark on MySQL shows an overhead between six and 10 percent on CPU-bound systems when running perf with the default sampling frequency of 4000 Hz.

Code 114

Code Tuning C++ Benchmarking 114

Dynatrace

AUGUST 5, 2020

This is definitely a great starting benchmark against which to optimize your application. Options are now available for you to fine-tune Visually complete calculation: You can now control various thresholds and timeouts as well as exclude specific elements from the calculation—see our Help page for details on configuration settings.

Metrics 215

Metrics Monitoring Performance Benchmarking 215

Dynatrace

MARCH 25, 2022

“We were able to … fine-tune our systems in a very performant way,” notes Hood. Parker aims to improve its digital customer experience and create a benchmark system that meets industry standards — one that can confidently make updates without affecting the performance or resilience of the system. ” B2B portal.

Benchmarking 172

Benchmarking Efficiency DevOps Tuning 172

Scalegrid

JULY 13, 2020

Compare ease of use across compatibility, extensions, tuning, operating systems, languages and support providers. PostgreSQL offers more light-weight tuning capabilities, like their Query Optimizer, and DBaaS platforms like ScaleGrid offer advanced slow query analysis. Compare Ease of Use.

Open Source 244

Open Source C++ Tuning Database 244

Dynatrace

APRIL 8, 2021

These served as our benchmark when creating our Lambda monitoring extension. So, stay tuned for more blog posts and announcements. Today, Lambda can be monitored by Dynatrace in hybrid environments, thereby satisfying the enterprise requirements. Top enterprise use-cases for AWS Lambda. Extending existing enterprise stacks.

Lambda 222

Lambda AWS Serverless Monitoring 222

Brendan Gregg

MARCH 7, 2020

Systems performance is an effective discipline for performance analysis and tuning, and can help you find performance wins for your applications and the kernel. However, most of us are not performance or kernel engineers, and have limited time to study this topic.

Systems 52

Systems Performance Tuning Benchmarking 52

Brendan Gregg

MARCH 7, 2020

Systems performance is an effective discipline for performance analysis and tuning, and can help you find performance wins for your applications and the kernel. However, most of us are not performance or kernel engineers, and have limited time to study this topic.

Systems 52

Systems Performance Benchmarking Tuning 52

High Scalability

AUGUST 24, 2021

No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. It combines state-of-the-art vector search libraries, advanced features such as filtering, and distributed infrastructure to provide high performance and reliability at any scale.

Education 100

Education DevOps Infrastructure Benchmarking 100

Percona

MARCH 27, 2023

Disclaimer : This blog post is meant to show a less-known problem but is not meant to be a serious benchmark. The percentage in degradation will vary depending on many factors {hardware, workload, number of tables, configuration, etc.}. Setup The setup consists of creating 10K tables with sysbench and adding 20 FKs to 20 tables.

Cache 106

Cache Hardware Servers Benchmarking 106

High Scalability

OCTOBER 27, 2021

No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. It combines state-of-the-art vector search libraries, advanced features such as filtering, and distributed infrastructure to provide high performance and reliability at any scale.

Education 100

Education DevOps Infrastructure Scalability 100

Scalegrid

OCTOBER 24, 2019

MySQL Performance Benchmark Configuration. For some of the tests on the ScaleGrid deployment, MySQL configuration binlog_group_commit_sync_delay is tuned so that the slave replication lag does not go beyond 30s. community edition. innodb_buffer_pool_size. innodb_log_file_size. innodb_flush_log_at_trx_commit. sync_binlog. LOGICAL_CLOCK.

AWS 183

AWS Latency Performance Open Source 183

Dynatrace

APRIL 8, 2021

These served as our benchmark when creating our Lambda monitoring extension. So, stay tuned for more blog posts and announcements. Today, Lambda can be monitored by Dynatrace in hybrid environments, thereby satisfying the enterprise requirements. Top enterprise use-cases for AWS Lambda. Extending existing enterprise stacks.

Lambda 183

Lambda AWS Serverless Monitoring 183

High Scalability

SEPTEMBER 29, 2021

No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. It combines state-of-the-art vector search libraries, advanced features such as filtering, and distributed infrastructure to provide high performance and reliability at any scale.

Education 100

Education DevOps Infrastructure Scalability 100

High Scalability

SEPTEMBER 15, 2021

No more hassles of benchmarking and tuning algorithms or building and maintaining infrastructure for vector search. It combines state-of-the-art vector search libraries, advanced features such as filtering, and distributed infrastructure to provide high performance and reliability at any scale.

Education 100

Education DevOps Infrastructure Scalability 100

Scalegrid

MARCH 22, 2024

Consistently evaluating and tuning resource allocations based on use patterns helps prevent overprovisioning and reduces unnecessary expenses. Establishing clear service-level agreements is key as they outline specific responsibilities and performance benchmarks expected from cloud service providers during disaster recovery scenarios.

Strategy 130

Strategy Cloud Government Innovation 130

The Morning Paper

NOVEMBER 28, 2019

Some of these examples have been hand-tuned to make them efficient for TLC to check, no such tuning is done for APALACHE. 4 seconds on this same benchmark). We hope that with the growing number of users, specifications will get tuned to our model checker, as is now happening with TLC. But when TLC starts to struggle (e.g.,

Tuning 106

Tuning Benchmarking Efficiency Systems 106