RESOLVED FIXED246701
RE-SYNC(255459@main): [ iOS iPadOS ] 7X imported/w3c/web-platform-tests/screen-orientation/(Layout tests) are constant/flaky failures
https://bugs.webkit.org/show_bug.cgi?id=246701
Summary RE-SYNC(255459@main): [ iOS iPadOS ] 7X imported/w3c/web-platform-tests/scree...
Hercules Hjalmarsson
Reported 2022-10-18 12:11:04 PDT
imported/w3c/web-platform-tests/screen-orientation/active-lock.html imported/w3c/web-platform-tests/screen-orientation/event-before-promise.html imported/w3c/web-platform-tests/screen-orientation/lock-basic.html imported/w3c/web-platform-tests/screen-orientation/lock-unlock-check.html imported/w3c/web-platform-tests/screen-orientation/onchange-event-subframe.html imported/w3c/web-platform-tests/screen-orientation/orientation-reading.html imported/w3c/web-platform-tests/screen-orientation/onchange-event.html Are 7 constant/Flaky text failure on iOS iPadOS ToT and since 255459@main. These were all rebaselined at 255459@main. However, now some are flakily failing and others are constantly failing on iPadOS. They all share a similar error (+Harness Error (TIMEOUT), message = null). HISTORY: https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fscreen-orientation%2Factive-lock.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fscreen-orientation%2Fevent-before-promise.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fscreen-orientation%2Flock-basic.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fscreen-orientation%2Flock-unlock-check.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fscreen-orientation%2Fonchange-event-subframe.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fscreen-orientation%2Fonchange-event.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fscreen-orientation%2Forientation-reading.html DIFF: --- /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/active-lock-expected.txt +++ /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/active-lock-actual.txt @@ -1,3 +1,5 @@ -PASS When performing a fragment navigation, the change must not abort +Harness Error (TIMEOUT), message = null +TIMEOUT When performing a fragment navigation, the change must not abort Test timed out + --- /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/event-before-promise-expected.txt +++ /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/event-before-promise-actual.txt @@ -1,3 +1,5 @@ -PASS The 'change' event must fire before the [[orientationPendingPromise]] is resolved. +Harness Error (TIMEOUT), message = null +TIMEOUT The 'change' event must fire before the [[orientationPendingPromise]] is resolved. Test timed out + --- /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/lock-basic-expected.txt +++ /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/lock-basic-actual.txt @@ -1,8 +1,10 @@ + +Harness Error (TIMEOUT), message = null PASS Test that screen.orientation.unlock() doesn't throw when there is no lock with fullscreen PASS Test that screen.orientation.unlock() doesn't throw when there is no lock PASS Test that screen.orientation.unlock() returns a void value PASS Test that screen.orientation.lock returns a promise which will be fulfilled with a void value. -PASS Test that screen.orientation.lock returns a pending promise. -PASS Test that screen.orientation.lock() is actually async +TIMEOUT Test that screen.orientation.lock returns a pending promise. Test timed out +NOTRUN Test that screen.orientation.lock() is actually async --- /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/lock-unlock-check-expected.txt +++ /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/lock-unlock-check-actual.txt @@ -1,3 +1,5 @@ -PASS Re-locking orientation during event dispatch must reject existing orientationPendingPromise +Harness Error (TIMEOUT), message = null +TIMEOUT Re-locking orientation during event dispatch must reject existing orientationPendingPromise Test timed out + --- /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/onchange-event-subframe-expected.txt +++ /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/onchange-event-subframe-actual.txt @@ -1,3 +1,5 @@ -PASS Test subframes receive orientation change events +Harness Error (TIMEOUT), message = null +TIMEOUT Test subframes receive orientation change events Test timed out + --- /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/onchange-event-expected.txt +++ /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/onchange-event-actual.txt @@ -1,4 +1,6 @@ + +Harness Error (TIMEOUT), message = null PASS Test that orientationchange event is not fired when the orientation does not change. -PASS Test that orientationchange event is fired when the orientation changes. +TIMEOUT Test that orientationchange event is fired when the orientation changes. Test timed out --- /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/orientation-reading-expected.txt +++ /Volumes/Data/worker/Apple-iPadOS-16-Simulator-Debug-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/screen-orientation/orientation-reading-actual.txt @@ -1,8 +1,10 @@ + +Harness Error (TIMEOUT), message = null PASS Test screen.orientation properties PASS Test screen.orientation default values. PASS Test the orientations and associated angles PASS Test that screen.orientation properties are not writable PASS Test that screen.orientation is always the same object -PASS Test that screen.orientation values change if the orientation changes +TIMEOUT Test that screen.orientation values change if the orientation changes Test timed out
Attachments
Radar WebKit Bug Importer
Comment 1 2022-10-18 12:11:27 PDT
Hercules Hjalmarsson
Comment 2 2022-10-18 12:15:19 PDT
This issue can be bisected to 255459@main using command: run-webkit-tests --iterations=2 --ipad-simulator imported/w3c/web-platform-tests/screen-orientation/onchange-event-subframe.html In order to get these to pass you may need to checkout the commits when testing.
Hercules Hjalmarsson
Comment 3 2022-10-18 12:21:51 PDT
imported/w3c/web-platform-tests/screen-orientation/orientation-reading.html Appears to have been failing since 255317@main.
EWS
Comment 4 2022-10-18 13:36:57 PDT
Test gardening commit 255696@main (9d1ed38bcc6d): <https://commits.webkit.org/255696@main> Reviewed commits have been landed. Closing PR #5509 and removing active labels.
Chris Dumez
Comment 6 2022-11-07 17:01:14 PST
EWS
Comment 7 2022-11-08 08:59:42 PST
Committed 256450@main (3e020b585a84): <https://commits.webkit.org/256450@main> Reviewed commits have been landed. Closing PR #6233 and removing active labels.
Note You need to log in before you can comment on or make changes to this bug.