article thumbnail

Evaluating the Evaluation: A Benchmarking Checklist

Brendan Gregg

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

article thumbnail

Evaluating the Evaluation: A Benchmarking Checklist

Brendan Gregg

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

The top 5 reasons to run your own database benchmarks

HammerDB

Some opinions claim that “Benchmarks are meaningless”, “benchmarks are irrelevant” or “benchmarks are nothing like your real applications” However for others “Benchmarks matter,” as they “account for the processing architecture and speed, memory, storage subsystems and the database engine.”

article thumbnail

Why Browsers Get Built

Alex Russell

In some sense it's a confidence-management exercise. Of course, it would be better from the OS vendor's perspective if everyone simply wrote all of the software for their proprietary platform, maximising OS feature differentiation. A Web as Meta-Platform endgame requires that the platform continues to improve in expressive capacity.

article thumbnail

How to Assess MySQL Performance

HammerDB

Among the different components of modern software solutions, the database is one of the most critical. Instead, focus on understanding what the workloads exercise to help us determine how to best use them to aid our performance assessment. We applied the following settings for both benchmarks to make it easier to stress the system.

article thumbnail

Fixing a slow site iteratively

CSS - Tricks

Google’s industry benchmarks from 2018 also provide a striking breakdown of how each second of loading affects bounce rates. With all of this in mind, I thought improving the speed of my own version of a slow site would be a fun exercise. But those are things I did in image editing software.

Cache 92
article thumbnail

A peculiar throughput limitation on Intel’s Xeon Phi x200 (Knights Landing)

John McCalpin

There was no deep goal — just a desire to see the maximum GFLOPS in action. The exercise seemed simple enough — just fix one item in the Colfax code and we should be finished. This is an uninspiring fraction of peak performance that would normally suggest significant inefficiencies in either the hardware or software.

Latency 40