Bug 207508

Summary:	[ Mac wk2 ] webgpu/whlsl/textures-load.html is flaky failing.
Product:	WebKit	Reporter:	Jason Lawrence <Lawrence.j>
Component:	WebGPU	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Mac
OS:	Unspecified

Description Jason Lawrence 2020-02-10 14:02:35 PST

webgpu/whlsl/textures-load.html

Description:
This test is flaky failing on Mac wk2.

History:
https://results.webkit.org/?suite=layout-tests&test=webgpu%2Fwhlsl%2Ftextures-load.html&limit=50000

Diff:
https://build.webkit.org/results/Apple-Catalina-Release-WK2-Tests/r256201%20(2833)/webgpu/whlsl/textures-load-diff.png

Note:
I was able to reproduce the issue on r256090 with this command:
run-webkit-tests http/wpt/mediarecorder/MediaRecorder-AV-audio-video-dataavailable-gpuprocess.html --iterations 5000 --debug exit-after-n-failures 5 --force

[205/5000] http/wpt/mediarecorder/MediaRecorder-AV-audio-video-dataavailable-gpuprocess.html failed unexpectedly (text diff)
[206/5000] http/wpt/mediarecorder/MediaRecorder-AV-audio-video-dataavailable-gpuprocess.html failed unexpectedly (text diff)
[207/5000] http/wpt/mediarecorder/MediaRecorder-AV-audio-video-dataavailable-gpuprocess.html failed unexpectedly (text diff)
[208/5000] http/wpt/mediarecorder/MediaRecorder-AV-audio-video-dataavailable-gpuprocess.html failed unexpectedly (text diff)
[209/5000] http/wpt/mediarecorder/MediaRecorder-AV-audio-video-dataavailable-gpuprocess.html failed unexpectedly (text diff)
[210/5000] http/wpt/mediarecorder/MediaRecorder-AV-audio-video-dataavailable-gpuprocess.html failed unexpectedly (text diff)
[211/5000] http/wpt/mediarecorder/MediaRecorder-AV-audio-video-dataavailable-gpuprocess.html failed unexpectedly (text diff)

204 tests ran as expected, 7 didn't (4789 didn't run):

Comment 1 Radar WebKit Bug Importer 2020-02-10 14:03:11 PST

<rdar://problem/59324744>

Comment 2 Jason Lawrence 2020-02-10 14:10:24 PST

I have marked the image test as failing while this is investigated.
https://trac.webkit.org/changeset/256211/webkit

Comment 3 Jason Lawrence 2020-02-11 15:17:56 PST

Please disregard the "Note:" in my original comment. I have not been able to reproduce the issue at this time.

Comment 4 Jason Lawrence 2020-02-13 08:41:35 PST

I was able to reproduce this issue with r256503 using the command below.

run-webkit-tests webgpu/whlsl/textures-load.html --iterations 3000 --exit-after-n-failures 5 --force -f

[801/3000] webgpu/whlsl/textures-load.html failed unexpectedly (reference mismatch)
[2144/3000] webgpu/whlsl/textures-load.html failed unexpectedly (reference mismatch)
[2360/3000] webgpu/whlsl/textures-load.html failed unexpectedly (reference mismatch)
[2566/3000] webgpu/whlsl/textures-load.html failed unexpectedly (reference mismatch)
Retrying 1 unexpected failure ...
Running 1 WebKitTestRunner.
2996 tests ran as expected, 4 didn't: