Bug 243734

Summary: REGRESSION(252960@main?): [ iOS ] 3X imported/w3c/web-platform-tests/html/cross-origin-opener-policy/(Layout Tests) are almost constant failures
Product: WebKit Reporter: Hercules Hjalmarsson <hhjalmarsson>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: RESOLVED DUPLICATE    
Severity: Normal CC: webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Hercules Hjalmarsson 2022-08-09 09:58:56 PDT
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https.html
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https.html
imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-to-same-origin.https.html

Are 3 almost constant text failures on iOS ToT. It appears that these tests share a similar (Harness Error (TIMEOUT), message = null) error which causes the 3 layout tests to fail frequently. They also appear to have the same regression point.

HISTORY:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Fiframe-popup-same-origin-allow-popups-to-unsafe-none.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Fiframe-popup-same-origin-to-same-origin.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fcross-origin-opener-policy%2Ftentative%2Frestrict-properties%2Fiframe-popup.https.html

DIFF:
--- /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https-expected.txt
+++ /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/cross-origin-opener-policy/iframe-popup-same-origin-allow-popups-to-unsafe-none.https-actual.txt
@@ -1,3 +1,6 @@
+
+
+Harness Error (TIMEOUT), message = null
 
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same origin iframe, same origin popup with window_open
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same origin iframe, same origin popup with anchor
@@ -24,6 +27,6 @@
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with anchor
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with same site iframe, cross origin popup with form
 PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with window_open
-PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with anchor
-PASS COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with form
+TIMEOUT COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with anchor Test timed out
+NOTRUN COOP: same-origin-allow-popups to popup COOP: unsafe-none via an iframe, with cross origin iframe, cross origin popup with form

URL:
https://build.webkit.org/results/Apple-iOS-15-Simulator-Release-WK2-Tests/253256@main%20(4052)/results.html
Comment 1 Radar WebKit Bug Importer 2022-08-09 09:59:19 PDT
<rdar://problem/98389860>
Comment 2 Hercules Hjalmarsson 2022-08-09 16:34:21 PDT
I'm unable to get these tests to fail/pass according to the history shown.

When running these tests with the --child-processes=X & -f parameter they always fail otherwise, they always pass. They also take a long time to run.

History would indicate that the regression should be around 252960@main.

Commands run:

run-webkit-tests --ios-simulator --child-processes=4 -f imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https.html

run-webkit-tests --ios-simulator imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https.html

run-webkit-tests --ios-simulator --debug --child-processes=4 -f imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https.html

run-webkit-tests --ios-simulator --debug imported/w3c/web-platform-tests/html/cross-origin-opener-policy/tentative/restrict-properties/iframe-popup.https.html

I also downloaded builds similar to the bots and ran the same commands.
Comment 3 Hercules Hjalmarsson 2022-08-09 16:41:46 PDT

*** This bug has been marked as a duplicate of bug 243690 ***