Bug 208220

Summary:	[ Mac Debug ] imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-control.html is flaky failing.
Product:	WebKit	Reporter:	Jason Lawrence <Lawrence.j>
Component:	Platform	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Mac
OS:	macOS 10.15

Description Jason Lawrence 2020-02-25 15:27:36 PST

imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-control.html

Description:
This test is flaky failing throughout the visible history on Mac Debug.The oldest diff that I am able to view, r254738, has the same data.

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fembedded-content%2Fmedia-elements%2Floading-the-media-resource%2Fresource-selection-pointer-insert-text.html&platform=mac&limit=50000&style=debug

Diff:
--- /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-control-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-control-actual.txt
@@ -1,3 +1,3 @@
 
-FAIL pointer updates (control test) assert_equals: error events on c expected 1 but got 0
+FAIL pointer updates (control test) assert_equals: error events on b expected 1 but got 0

Comment 1 Radar WebKit Bug Importer 2020-02-25 15:28:00 PST

<rdar://problem/59783588>

Comment 2 Jason Lawrence 2020-02-25 15:33:39 PST

I have marked this test as failing while this issue is investigated.
https://trac.webkit.org/changeset/257384/webkit

Comment 3 Jason Lawrence 2020-02-28 09:07:57 PST

I can reproduce this issue with r257637 using the command below.

run-webkit-tests --platform mac-mojave --iterations 4800 --exit-after-n-failures 5 imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-control.html -1 -g --force -f

[258/4800] imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-control.html failed unexpectedly (text diff)
[293/4800] imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-control.html failed unexpectedly (text diff)
[705/4800] imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-control.html failed unexpectedly (text diff)
[1084/4800] imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-control.html failed unexpectedly (text diff)
[1975/4800] imported/w3c/web-platform-tests/html/semantics/embedded-content/media-elements/loading-the-media-resource/resource-selection-pointer-control.html failed unexpectedly (text diff)
Exiting early after 5 failures. 1972 tests run.

1967 tests ran as expected, 5 didn't (2828 didn't run):