Bug 207599

Summary:	[ Mac wk2 ] webgpu/whlsl/do-while-loop.html is flaky failing.
Product:	WebKit	Reporter:	Jason Lawrence <Lawrence.j>
Component:	WebGPU	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Mac
OS:	macOS 10.15

Description Jason Lawrence 2020-02-11 16:34:16 PST

webgpu/whlsl/do-while-loop.html

Description:
This test is flaky failing throughout the visible history on Mac wk2. The oldest diff that I am able to find, related to r253677, shows the same image and percentage. 

History:
https://results.webkit.org/?suite=layout-tests&test=webgpu%2Fwhlsl%2Fdo-while-loop.html&limit=50000

Diff:
https://build.webkit.org/results/Apple-Catalina-Release-WK2-Tests/r254422%20(2065)/webgpu/whlsl/do-while-loop-diff.png

Comment 1 Radar WebKit Bug Importer 2020-02-11 16:34:42 PST

<rdar://problem/59369220>

Comment 2 Jason Lawrence 2020-02-11 16:47:59 PST

I have marked this test as failing while the issue is investigated.
https://trac.webkit.org/changeset/256398/webkit

Comment 3 Jason Lawrence 2020-02-12 08:06:12 PST

I am able to reproduce this issue with r256430 using the command below.

run-webkit-tests webgpu/whlsl/do-while-loop.html --iterations 5000.

Running 6 WebKitTestRunners in parallel.
[792/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[1214/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[1999/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[2101/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[2483/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[2771/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[3550/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[3680/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[3962/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[4803/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)
[4924/5000] webgpu/whlsl/do-while-loop.html failed unexpectedly (reference mismatch)