Bug 246701

Summary: RE-SYNC(255459@main): [ iOS iPadOS ] 7X imported/w3c/web-platform-tests/screen-orientation/(Layout tests) are constant/flaky failures
Product: WebKit Reporter: Hercules Hjalmarsson <hhjalmarsson>
Component: New BugsAssignee: Chris Dumez <cdumez>
Status: RESOLVED FIXED    
Severity: Normal CC: cdumez, thorton, webkit-bot-watchers-bugzilla, webkit-bug-importer, wenson_hsieh
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Hercules Hjalmarsson 2022-10-18 12:11:04 PDT 
imported/w3c/web-platform-tests/screen-orientation/active-lock.html
imported/w3c/web-platform-tests/screen-orientation/event-before-promise.html
imported/w3c/web-platform-tests/screen-orientation/lock-basic.html
imported/w3c/web-platform-tests/screen-orientation/lock-unlock-check.html
imported/w3c/web-platform-tests/screen-orientation/onchange-event-subframe.html
imported/w3c/web-platform-tests/screen-orientation/orientation-reading.html
imported/w3c/web-platform-tests/screen-orientation/onchange-event.html

Are 7 constant/Flaky text failure on iOS iPadOS ToT and since 255459@main. These were all rebaselined at 255459@main. However, now some are flakily failing and others are constantly failing on iPadOS. They all share a similar error (+Harness Error (TIMEOUT), message = null).

HISTORY:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fscreen-orientation%2Factive-lock.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fscreen-orientation%2Fevent-before-promise.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fscreen-orientation%2Flock-basic.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fscreen-orientation%2Flock-unlock-check.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fscreen-orientation%2Fonchange-event-subframe.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fscreen-orientation%2Fonchange-event.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fscreen-orientation%2Forientation-reading.html

DIFF:
--- /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/active-lock-expected.txt
+++ /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/active-lock-actual.txt
@@ -1,3 +1,5 @@
 
-PASS When performing a fragment navigation, the change must not abort
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT When performing a fragment navigation, the change must not abort Test timed out
+

--- /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/event-before-promise-expected.txt
+++ /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/event-before-promise-actual.txt
@@ -1,3 +1,5 @@
 
-PASS The 'change' event must fire before the [[orientationPendingPromise]] is resolved.
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT The 'change' event must fire before the [[orientationPendingPromise]] is resolved. Test timed out
+

--- /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/lock-basic-expected.txt
+++ /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/lock-basic-actual.txt
@@ -1,8 +1,10 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS Test that screen.orientation.unlock() doesn't throw when there is no lock with fullscreen
 PASS Test that screen.orientation.unlock() doesn't throw when there is no lock
 PASS Test that screen.orientation.unlock() returns a void value
 PASS Test that screen.orientation.lock returns a promise which will be fulfilled with a void value.
-PASS Test that screen.orientation.lock returns a pending promise.
-PASS Test that screen.orientation.lock() is actually async
+TIMEOUT Test that screen.orientation.lock returns a pending promise. Test timed out
+NOTRUN Test that screen.orientation.lock() is actually async
 
--- /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/lock-unlock-check-expected.txt
+++ /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/lock-unlock-check-actual.txt
@@ -1,3 +1,5 @@
 
-PASS Re-locking orientation during event dispatch must reject existing orientationPendingPromise
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT Re-locking orientation during event dispatch must reject existing orientationPendingPromise Test timed out
+

--- /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/onchange-event-subframe-expected.txt
+++ /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/onchange-event-subframe-actual.txt
@@ -1,3 +1,5 @@
 
-PASS Test subframes receive orientation change events
+Harness Error (TIMEOUT), message = null
 
+TIMEOUT Test subframes receive orientation change events Test timed out
+

--- /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/onchange-event-expected.txt
+++ /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/onchange-event-actual.txt
@@ -1,4 +1,6 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS Test that orientationchange event is not fired when the orientation does not change.
-PASS Test that orientationchange event is fired when the orientation changes.
+TIMEOUT Test that orientationchange event is fired when the orientation changes. Test timed out
 

--- /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/orientation-reading-expected.txt
+++ /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/orientation-reading-actual.txt
@@ -1,8 +1,10 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS Test screen.orientation properties
 PASS Test screen.orientation default values.
 PASS Test the orientations and associated angles
 PASS Test that screen.orientation properties are not writable
 PASS Test that screen.orientation is always the same object
-PASS Test that screen.orientation values change if the orientation changes
+TIMEOUT Test that screen.orientation values change if the orientation changes Test timed out
Comment 1 Radar WebKit Bug Importer 2022-10-18 12:11:27 PDT 
<rdar://problem/101303037>
Comment 2 Hercules Hjalmarsson 2022-10-18 12:15:19 PDT 
This issue can be bisected to 255459@main using command:

run-webkit-tests --iterations=2  --ipad-simulator  imported/w3c/web-platform-tests/screen-orientation/onchange-event-subframe.html

In order to get these to pass you may need to checkout the commits when testing.
Comment 3 Hercules Hjalmarsson 2022-10-18 12:21:51 PDT 
imported/w3c/web-platform-tests/screen-orientation/orientation-reading.html

Appears to have been failing since 255317@main.
Comment 4 EWS 2022-10-18 13:36:57 PDT 
Test gardening commit 255696@main (9d1ed38bcc6d): <https://commits.webkit.org/255696@main>

Reviewed commits have been landed. Closing PR #5509 and removing active labels.
Comment 6 Chris Dumez 2022-11-07 17:01:14 PST 
Pull request: https://github.com/WebKit/WebKit/pull/6233
Comment 7 EWS 2022-11-08 08:59:42 PST 
Committed 256450@main (3e020b585a84): <https://commits.webkit.org/256450@main>

Reviewed commits have been landed. Closing PR #6233 and removing active labels.