Remove Benchmarking Remove Exercise Remove Latency Remove Storage
article thumbnail

Evaluating the Evaluation: A Benchmarking Checklist

Brendan Gregg

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?

article thumbnail

Evaluating the Evaluation: A Benchmarking Checklist

Brendan Gregg

These have inspired me to summarize another performance activity: evaluating benchmark accuracy. Accurate benchmarking rewards engineering investment that actually improves performance, but, unfortunately, inaccurate benchmarking is more common. If the benchmark reported 20k ops/sec, you should ask: why not 40k ops/sec?