Bug 208005

Summary:

[ Mac wk2 ] webgpu/whlsl/zero-initialize-values.html is flaky failing.

Product:

WebKit

Reporter:

Jason Lawrence <Lawrence.j>

Component:

WebGPU

Assignee:

Nobody <webkit-unassigned>

Status:

NEW ---

Severity:

Normal

CC:

webkit-bot-watchers-bugzilla, webkit-bug-importer

Priority:

Keywords:

InRadar

Version:

WebKit Nightly Build

Hardware:

Mac

OS:

macOS 10.15

Attachments:

Description	Flags
https://build.webkit.org/results/Apple-Catalina-Debug-WK2-Tests/r257050%20(2433)/webgpu/whlsl/zero-initialize-values-diff.png	none

Description Jason Lawrence 2020-02-20 07:46:32 PST

Created attachment 391287 [details]
https://build.webkit.org/results/Apple-Catalina-Debug-WK2-Tests/r257050%20(2433)/webgpu/whlsl/zero-initialize-values-diff.png

webgpu/whlsl/zero-initialize-values.html

Description:
This test is flaky failing on Mac. The test is flaky failing throughout the visible history. The oldest diff that I am able to load, r254201, has the same percentage and looks the same.

History:
https://results.webkit.org/?suite=layout-tests&test=webgpu%2Fwhlsl%2Fzero-initialize-values.html&limit=50000

Diff:
https://build.webkit.org/results/Apple-Catalina-Debug-WK2-Tests/r257050%20(2433)/webgpu/whlsl/zero-initialize-values-diff.png

Comment 1 Radar WebKit Bug Importer 2020-02-20 07:46:56 PST

<rdar://problem/59628835>

Comment 2 Jason Lawrence 2020-02-20 07:50:43 PST

I have marked this test as failing while this issue is investigated.
https://trac.webkit.org/changeset/257060/webkit

Comment 3 Jason Lawrence 2020-02-20 07:52:22 PST

I can reproduce the issue with r257052 using the command below.
run-webkit-tests webgpu/whlsl/zero-initialize-values.html --iterations 4000 --exit-after-n-failures 5 -f --force -g

[33/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch)
[38/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch)
[50/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch)
[60/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch)
[61/4000] webgpu/whlsl/zero-initialize-values.html failed unexpectedly (reference mismatch)
Exiting early after 5 failures. 58 tests run.

53 tests ran as expected, 5 didn't (3942 didn't run):