Sat.Jun 30, 2018

article thumbnail

Evaluating the Evaluation: A Benchmarking Checklist

Brendan Gregg

A co-worker introduced me to Craig Hanson and Pat Crain's performance mantras, which neatly summarize much of what we do in performance analysis and tuning. They are: **Performance mantras**. Don't do it. Do it, but don't do it again. Do it less. Do it later. Do it when they're not looking. Do it concurrently. Do it cheaper. These have inspired me to summarize another performance activity: evaluating benchmark accuracy.