NEW 111895
run-perf-tests should make the "mean" stand out in its output 
https://bugs.webkit.org/show_bug.cgi?id=111895
Summary run-perf-tests should make the "mean" stand out in its output
Eric Seidel (no email)
Reported 2013-03-08 15:39:55 PST
run-perf-tests should report the mean instead of (in addition to?) the median I'm told I should be reporting the mean in my bugs: https://bugs.webkit.org/show_bug.cgi?id=107337#c40 I may have been a Math major, but I plead ignorance for stats questions. :)
Attachments
Add attachment proposed patch, testcase, etc.
Ryosuke Niwa
Comment 1 2013-03-08 15:44:29 PST
(In reply to comment #0) > run-perf-tests should report the mean instead of (in addition to?) the median > > I'm told I should be reporting the mean in my bugs: > https://bugs.webkit.org/show_bug.cgi?id=107337#c40 > > I may have been a Math major, but I plead ignorance for stats questions. :) We do report them. e.g. Running Bindings/document-implementation.html (4 of 114) DESCRIPTION: This benchmark repeatedly accesses document.implementation. RESULT Bindings: document-implementation: Runs= 337.387461737 runs/s median= 336.553080486 runs/s, stdev= 8.51712865431 runs/s, min= 321.659870522 runs/s, max= 347.246989122 runs/s The mean is 337.387461737 runs/s.
Eric Seidel (no email)
Comment 2 2013-03-08 15:55:09 PST
I see. That was not at all obvious to me in reading the output, but perhaps it should have been.
Ryosuke Niwa
Comment 3 2013-03-08 15:55:50 PST
(In reply to comment #2) > I see. That was not at all obvious to me in reading the output, but perhaps it should have been. If it was't obvious to you, it clearly is a bug. Let's fix that.
Note You need to log in before you can comment on or make changes to this bug.