Bug 243688

Summary:	[ iOS ] 15X imported/w3c/web-platform-tests/upgrade-insecure-requests/gen(Layout tests) are a constant failure
Product:	WebKit	Reporter:	Hercules Hjalmarsson <hhjalmarsson>
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Hercules Hjalmarsson 2022-08-08 14:02:08 PDT

imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/iframe-blank-inherit.meta/upgrade/websocket.https.html
imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/sharedworker-classic.http-rp/upgrade/fetch.https.html
imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/sharedworker-classic.http-rp/upgrade/websocket.https.html
imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/sharedworker-classic.http-rp/upgrade/xhr.https.html
imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/sharedworker-module.http-rp/upgrade/fetch.https.html
imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/sharedworker-module.http-rp/upgrade/websocket.https.html
imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/sharedworker-module.http-rp/upgrade/xhr.https.html
imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/srcdoc-inherit.meta/upgrade/websocket.https.html
imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/top.http-rp/upgrade/websocket.https.html
imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/top.meta/upgrade/websocket.https.html
imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/worker-classic-data.meta/upgrade/websocket.https.html
imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/worker-classic.http-rp/upgrade/websocket.https.html
imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/worker-module-data.http-rp/upgrade/websocket.https.html
imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/worker-module-data.meta/upgrade/websocket.https.html
imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/worker-module.http-rp/upgrade/websocket.https.html

Are 15 layout tests that constantly fail on iOS ToT and since they were introduced at 253162@main. They all share a similar DIFF error (assert_equals: The resource request should be 'allowed'. expected "allowed" but got "blocked") which is preventing them from passing fully on iOS.

HISTORY:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Fworker-module.http-rp%2Fupgrade%2Fwebsocket.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Fworker-module-data.meta%2Fupgrade%2Fwebsocket.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Fworker-module-data.http-rp%2Fupgrade%2Fwebsocket.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Fworker-classic.http-rp%2Fupgrade%2Fwebsocket.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Fworker-classic-data.meta%2Fupgrade%2Fwebsocket.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Ftop.meta%2Fupgrade%2Fwebsocket.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Ftop.http-rp%2Fupgrade%2Fwebsocket.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Fsrcdoc-inherit.meta%2Fupgrade%2Fwebsocket.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Fsharedworker-module.http-rp%2Fupgrade%2Fxhr.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Fsharedworker-module.http-rp%2Fupgrade%2Fwebsocket.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Fsharedworker-module.http-rp%2Fupgrade%2Ffetch.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Fsharedworker-classic.http-rp%2Fupgrade%2Fxhr.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Fsharedworker-classic.http-rp%2Fupgrade%2Fwebsocket.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Fsharedworker-classic.http-rp%2Fupgrade%2Ffetch.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fupgrade-insecure-requests%2Fgen%2Fiframe-blank-inherit.meta%2Fupgrade%2Fwebsocket.https.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebaudio%2Fthe-audio-api%2Fthe-audiocontext-interface%2Faudiocontext-getoutputtimestamp-cross-realm.html

DIFF:

--- /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/iframe-blank-inherit.meta/upgrade/websocket.https-expected.txt
+++ /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/iframe-blank-inherit.meta/upgrade/websocket.https-actual.txt
@@ -1,4 +1,4 @@
 
-PASS Upgrade-Insecure-Requests: Expects allowed for websocket to cross-ws-downgrade origin and no-redirect redirection from https context.
+FAIL Upgrade-Insecure-Requests: Expects allowed for websocket to cross-ws-downgrade origin and no-redirect redirection from https context. assert_equals: The resource request should be 'allowed'. expected "allowed" but got "blocked"
 PASS Upgrade-Insecure-Requests: Expects allowed for websocket to same-ws-downgrade origin and no-redirect redirection from https context.

DIFF URL:

https://build.webkit.org/results/Apple-iOS-15-Simulator-Release-WK2-Tests/253211%40main%20(4042)/imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/iframe-blank-inherit.meta/upgrade/websocket.https-pretty-diff.html

Comment 1 Radar WebKit Bug Importer 2022-08-08 14:02:32 PDT

<rdar://problem/98339729>

Comment 2 Hercules Hjalmarsson 2022-08-08 14:03:52 PDT

Note: All these tests are constant text failures on iOS.

Comment 3 EWS 2022-08-08 14:33:04 PDT

Test gardening commit 253235@main (a95affbbc578): <https://commits.webkit.org/253235@main>

Reviewed commits have been landed. Closing PR #3114 and removing active labels.

Comment 4 Hercules Hjalmarsson 2022-08-08 14:37:29 PDT

I'm able to reproduce this failure on iOS ToT running command:

run-webkit-tests --ios-simulator imported/w3c/web-platform-tests/upgrade-insecure-requests/gen/iframe-blank-inherit.meta/upgrade/websocket.https.html