Benchmark builder
Paste timing samples per variant and compare mean, median and variance.
Loading tool…
About the benchmark builder
Paste timing samples for each variant and get mean, median, standard deviation, relative standard deviation and range side by side, with the winner marked and the others expressed as a multiple. Output is also formatted as a Markdown table for pasting into a pull request.
Frequently asked questions
Why does relative standard deviation matter?
It tells you whether a difference is real. Above about 10% the run is noisy, and a 5% gap between variants is indistinguishable from measurement error.
Mean or median?
Median resists outliers, which matters because a single garbage collection pause or context switch can drag the mean noticeably. When the two disagree, look at your raw samples.