Bug 111895
| Summary: | run-perf-tests should make the "mean" stand out in its output | ||
|---|---|---|---|
| Product: | WebKit | Reporter: | Eric Seidel (no email) <eric> |
| Component: | New Bugs | Assignee: | Nobody <webkit-unassigned> |
| Status: | NEW | ||
| Severity: | Normal | CC: | abarth, dpranke, rniwa |
| Priority: | P2 | ||
| Version: | 528+ (Nightly build) | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
Eric Seidel (no email)
run-perf-tests should report the mean instead of (in addition to?) the median
I'm told I should be reporting the mean in my bugs:
https://bugs.webkit.org/show_bug.cgi?id=107337#c40
I may have been a Math major, but I plead ignorance for stats questions. :)
| Attachments | ||
|---|---|---|
| Add attachment proposed patch, testcase, etc. |
Ryosuke Niwa
(In reply to comment #0)
> run-perf-tests should report the mean instead of (in addition to?) the median
>
> I'm told I should be reporting the mean in my bugs:
> https://bugs.webkit.org/show_bug.cgi?id=107337#c40
>
> I may have been a Math major, but I plead ignorance for stats questions. :)
We do report them. e.g.
Running Bindings/document-implementation.html (4 of 114)
DESCRIPTION: This benchmark repeatedly accesses document.implementation.
RESULT Bindings: document-implementation: Runs= 337.387461737 runs/s
median= 336.553080486 runs/s, stdev= 8.51712865431 runs/s, min= 321.659870522 runs/s, max= 347.246989122 runs/s
The mean is 337.387461737 runs/s.
Eric Seidel (no email)
I see. That was not at all obvious to me in reading the output, but perhaps it should have been.
Ryosuke Niwa
(In reply to comment #2)
> I see. That was not at all obvious to me in reading the output, but perhaps it should have been.
If it was't obvious to you, it clearly is a bug. Let's fix that.