Bug 216492

Summary:	[ macOS iOS Debug ] imported/w3c/web-platform-tests/selection/*: 4 tests are flaky timeouts
Product:	WebKit	Reporter:	Hector Lopez <hector_i_lopez>
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED CONFIGURATION CHANGED
Severity:	Normal	CC:	achristensen, rniwa, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=216301 https://bugs.webkit.org/show_bug.cgi?id=231299

Description Hector Lopez 2020-09-14 12:44:01 PDT

[ macOS Debug ] imported/w3c/web-platform-tests/selection/collapse-15.html
[ macOS Debug ] imported/w3c/web-platform-tests/selection/collapse-45.html
[ macOS Debug ] imported/w3c/web-platform-tests/selection/extend-00.html
[ macOS iOS Debug ] imported/w3c/web-platform-tests/selection/extend-20.html

Test are flaky timeouts according to history on macOS and iOS. First occurrences are fairly close to update at https://trac.webkit.org/changeset/266784/webkit

History:
https://results.webkit.org/?platform=ios&platform=mac&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fselection%2Fstringifier.tentative.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fselection%2Ftest-iframe.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fselection%2FtoString-ff-bug-001.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fselection%2Ftype.html

Timeouts:
imported/w3c/web-platform-tests/selection/extend-20.html:
Diff:
--- /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/selection/extend-20-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/selection/extend-20-actual.txt
@@ -1,3 +1,4 @@
+FAIL: Timed out waiting for notifyDone to be called
 
 FAIL extend() with range 23 [paras[0], 0, paras[0], 0] and point 0 [paras[0].firstChild, -1] assert_equals: Sanity check: startContainer must be correct expected Element node <p id="a">Äb̈c̈d̈ëf̈g̈ḧ
 </p> but got Text node "Äb̈c̈d̈ëf̈g̈ḧ

imported/w3c/web-platform-tests/selection/extend-00.html:
Diff:
--- /Volumes/Data/slave/mojave-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/selection/extend-00-expected.txt
+++ /Volumes/Data/slave/mojave-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/selection/extend-00-actual.txt
@@ -1,3 +1,4 @@
+FAIL: Timed out waiting for notifyDone to be called
 
 PASS extend() with range 1 [paras[0].firstChild, 0, paras[0].firstChild, 0] and point 0 [paras[0].firstChild, -1] 
 PASS extend() with range 1 [paras[0].firstChild, 0, paras[0].firstChild, 0] and point 1 [paras[0].firstChild, 0]

imported/w3c/web-platform-tests/selection/collapse-15.html
Diff:
--- /Volumes/Data/slave/mojave-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/selection/collapse-15-expected.txt
+++ /Volumes/Data/slave/mojave-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/selection/collapse-15-actual.txt
@@ -1,3 +1,4 @@
+FAIL: Timed out waiting for notifyDone to be called
 
 PASS Set up range 15 [document.documentElement, 0, document.documentElement, 1] 
 PASS Set up range 16 [document.documentElement, 0, document.documentElement, 2]

imported/w3c/web-platform-tests/selection/collapse-45.html
Diff:
--- /Volumes/Data/slave/mojave-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/selection/collapse-45-expected.txt
+++ /Volumes/Data/slave/mojave-debug-tests-wk1/build/layout-test-results/imported/w3c/web-platform-tests/selection/collapse-45-actual.txt
@@ -1,3 +1,4 @@
+FAIL: Timed out waiting for notifyDone to be called
 
 PASS Set up range 30 [paras[0], 0, paras[0].firstChild, 7] 
 PASS Set up range 31 [testDiv, 2, paras[4], 1]

Comment 1 Radar WebKit Bug Importer 2020-09-14 12:44:19 PDT

<rdar://problem/68872422>

Comment 2 Hector Lopez 2020-09-14 13:10:02 PDT

Test expectation while investigated:

https://trac.webkit.org/changeset/267033/webkit

Comment 3 Alex Christensen 2020-09-14 15:19:26 PDT

They probably just take too long to run.  We should mark them as slow in debug or even just skip them in debug everywhere.