Bug 206752

Summary: [iOS wk2 release and Mac] imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html flaky failure
Product: WebKit Reporter: Jason Lawrence <Lawrence.j>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: darin, tsavell, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
Update Test Expectations none

Description Jason Lawrence 2020-01-24 09:12:52 PST 
imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html 

Description:
This test is flaky failing in iOS wk2 release and Mac.

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2F2dcontext%2Fimagebitmap%2FcreateImageBitmap-serializable.html

Diff:
--- /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable-actual.txt
@@ -1,4 +1,3 @@
-CONSOLE MESSAGE: line 2: TypeError: Type error
 
 PASS Serialize ImageBitmap created from an HTMLCanvasElement 
 PASS Serialize ImageBitmap created from an HTMLVideoElement
Comment 1 Radar WebKit Bug Importer 2020-01-24 09:13:16 PST 
<rdar://problem/58869582>
Comment 2 Jason Lawrence 2020-01-24 10:57:50 PST 
This looks like it may have regressed around 254399.
Comment 3 Darin Adler 2020-01-25 08:11:01 PST 
r254399 is when a new version of this test and its expected result was first landed, so there’s no reason to think this became more flaky because of a software change. It’s just that the new part of the test is flaky. And what seems flaky is the question of whether a type error is logged to the console.

I wish I knew more about where the type error was coming from, even which JavaScript source file.
Comment 4 Jason Lawrence 2020-01-28 10:46:27 PST 
Created attachment 389031 [details]
Update Test Expectations
Comment 5 Truitt Savell 2020-01-28 10:48:47 PST 
Comment on attachment 389031 [details]
Update Test Expectations

Clearing flags on attachment: 389031

Committed r255259: <https://trac.webkit.org/changeset/255259>
Comment 6 Jason Lawrence 2020-02-13 09:58:53 PST 
I am able to reproduce this issue with r256503 using the command below.
run-webkit-tests imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html --iterations 3000 --exit-after-n-failures 5 --force -f

18/3000] imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html failed unexpectedly (text diff)
[24/3000] imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html failed unexpectedly (text diff)
[26/3000] imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html failed unexpectedly (text diff)
[27/3000] imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html failed unexpectedly (text diff)
[32/3000] imported/w3c/web-platform-tests/2dcontext/imagebitmap/createImageBitmap-serializable.html failed unexpectedly (text diff)
Exiting early after 5 failures. 27 tests run.

22 tests ran as expected, 5 didn't (2973 didn't run):