Bug 207395

Summary:	[ Mac Debug ] imported/w3c/web-platform-tests/workers/WorkerGlobalScope_ErrorEvent_lineno.htm is flaky failing.
Product:	WebKit	Reporter:	Jason Lawrence <Lawrence.j>
Component:	Tools / Tests	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Mac
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=184323

Description Jason Lawrence 2020-02-07 10:39:47 PST

imported/w3c/web-platform-tests/workers/WorkerGlobalScope_ErrorEvent_lineno.htm

Description:
This test is flaky failing on Mac debug.

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fworkers%2FWorkerGlobalScope_ErrorEvent_lineno.htm&platform=mac&style=debug

Diff:
--- /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/workers/WorkerGlobalScope_ErrorEvent_lineno-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/workers/WorkerGlobalScope_ErrorEvent_lineno-actual.txt
@@ -1,4 +1,3 @@
-CONSOLE MESSAGE: line 3: Error: Error Message
 
 PASS  WorkerGlobalScope onerror event handler argument: line

Comment 1 Radar WebKit Bug Importer 2020-02-07 10:48:20 PST

<rdar://problem/59264859>

Comment 2 Jason Lawrence 2020-02-07 10:53:01 PST

I have marked this test as failing while it is being investigated.
https://trac.webkit.org/changeset/256035/webkit

Comment 3 Jason Lawrence 2020-02-10 07:59:25 PST

I was able to reproduce this issue on r256167 (debug) using the following command:

run-webkit-tests imported/w3c/web-platform-tests/workers/WorkerGlobalScope_ErrorEvent_lineno.htm  -f --force  --exit-after-n-failures 5 --iterations 5000

This is the output:
[2822/5000] imported/w3c/web-platform-tests/workers/WorkerGlobalScope_ErrorEvent_lineno.htm failed unexpectedly (text diff)
[2826/5000] imported/w3c/web-platform-tests/workers/WorkerGlobalScope_ErrorEvent_lineno.htm failed unexpectedly (text diff)
[3500/5000] imported/w3c/web-platform-tests/workers/WorkerGlobalScope_ErrorEvent_lineno.htm failed unexpectedly (text diff)
[3829/5000] imported/w3c/web-platform-tests/workers/WorkerGlobalScope_ErrorEvent_lineno.htm failed unexpectedly (text diff)
[3990/5000] imported/w3c/web-platform-tests/workers/WorkerGlobalScope_ErrorEvent_lineno.htm failed unexpectedly (text diff)
Exiting early after 5 failures. 3987 tests run.

3982 tests ran as expected, 5 didn't (1013 didn't run):