Bug 244230

Summary:	New landed baselines (253081@main): [ macOS wk1 ] Six imported/w3c/web-platform-tests/html/browsers/browsing-the-web/navigating-across-documents/replace-before-load/ tests are a flaky failure
Product:	WebKit	Reporter:	Karl Rackler <rackler>
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	cdumez, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Karl Rackler 2022-08-22 16:50:15 PDT

Description:
imported/w3c/web-platform-tests/html/browsers/browsing-the-web/navigating-across-documents/replace-before-load/a-click-during-load.html
imported/w3c/web-platform-tests/html/browsers/browsing-the-web/navigating-across-documents/replace-before-load/a-click-during-pageshow.html
imported/w3c/web-platform-tests/html/browsers/browsing-the-web/navigating-across-documents/replace-before-load/a-click.html
imported/w3c/web-platform-tests/html/browsers/browsing-the-web/navigating-across-documents/replace-before-load/history-pushstate-during-load.html
imported/w3c/web-platform-tests/html/browsers/browsing-the-web/navigating-across-documents/replace-before-load/history-pushstate-during-pageshow.html
imported/w3c/web-platform-tests/html/browsers/browsing-the-web/navigating-across-documents/replace-before-load/history-pushstate.html

These are new baselines added.  The tests are only flaky failing on macOS wk1 on the assert by a factor of 1 for all tests.

REPRODUCTION STEPS
I can reproduce this on Tot ( 253657@main ).

Command: 
run-webkit-tests -1 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 1000 -f --no-retry imported/w3c/web-platform-tests/html/browsers/browsing-the-web/navigating-across-documents/replace-before-load/a-click-during-load.html

Result: 
Unexpected flakiness: text-only failures (1)
  imported/w3c/web-platform-tests/html/browsers/browsing-the-web/navigating-across-documents/replace-before-load/a-click-during-load.html [ Pass Failure ]

History:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fbrowsers%2Fbrowsing-the-web%2Fnavigating-across-documents%2Freplace-before-load%2Fa-click-during-load.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fbrowsers%2Fbrowsing-the-web%2Fnavigating-across-documents%2Freplace-before-load%2Fa-click-during-pageshow.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fbrowsers%2Fbrowsing-the-web%2Fnavigating-across-documents%2Freplace-before-load%2Fa-click.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fbrowsers%2Fbrowsing-the-web%2Fnavigating-across-documents%2Freplace-before-load%2Fhistory-pushstate-during-load.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fbrowsers%2Fbrowsing-the-web%2Fnavigating-across-documents%2Freplace-before-load%2Fhistory-pushstate-during-pageshow.html&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fbrowsers%2Fbrowsing-the-web%2Fnavigating-across-documents%2Freplace-before-load%2Fhistory-pushstate.html&platform=mac&flavor=wk1&limit=50000

Diff:
--- /Volumes/Data/worker/Apple-Monterey-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/browsers/browsing-the-web/navigating-across-documents/replace-before-load/a-click-during-load-expected.txt
+++ /Volumes/Data/worker/Apple-Monterey-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/html/browsers/browsing-the-web/navigating-across-documents/replace-before-load/a-click-during-load-actual.txt
@@ -1,4 +1,4 @@
 
 
-PASS aElement.click() during the load event must NOT replace
+FAIL aElement.click() during the load event must NOT replace assert_equals: history.length must change after waiting for the load expected 101 but got 100

Comment 1 Radar WebKit Bug Importer 2022-08-22 16:50:32 PDT

<rdar://problem/99005701>

Comment 2 Karl Rackler 2022-08-22 16:56:10 PDT

I have marked these tests as a flaky failure while this issue is investigated.

Comment 3 EWS 2022-08-22 17:00:57 PDT

Test gardening commit 253664@main (ee80380696ab): <https://commits.webkit.org/253664@main>

Reviewed commits have been landed. Closing PR #3561 and removing active labels.