Bug 244308

Summary: Test addition (252580@main): [ macOS wk1 ] imported/w3c/web-platform-tests/cookies/attributes/attributes-ctl.sub.html is a flaky failure
Product: WebKit Reporter: Karl Rackler <rackler>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: cdumez, webkit-bot-watchers-bugzilla, webkit-bug-importer, wilander
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=242712

Description Karl Rackler 2022-08-24 14:41:24 PDT
Description:
imported/w3c/web-platform-tests/cookies/attributes/attributes-ctl.sub.html

The test is a resync web-platform-tests/cookies from upstream at 252580@main.  The test is consistently failing on iOS and flaky failing on macOS.  Test expectations are in place for wk2, but not wk1.

REPRODUCTION STEPS
I can reproduce this on 253735@main ToT.

Command: 
run-webkit-tests --root 253735@main -1 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 -f --no-retry imported/w3c/web-platform-tests/cookies/attributes/attributes-ctl.sub.html

Result: 
Unexpected flakiness: text-only failures (1)
  imported/w3c/web-platform-tests/cookies/attributes/attributes-ctl.sub.html [ Failure Pass ]

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcookies%2Fattributes%2Fattributes-ctl.sub.html&platform=mac&limit=50000&flavor=wk1

Diff:
--- /Volumes/Data/worker/Apple-Monterey-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/cookies/attributes/attributes-ctl.sub-expected.txt
+++ /Volumes/Data/worker/Apple-Monterey-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/cookies/attributes/attributes-ctl.sub-actual.txt
@@ -116,7 +116,7 @@
 FAIL Cookie with %x8 in HttpOnly attribute is handled correctly. assert_equals: The cookie was rejected. expected "" but got "test8httponly=t"
 FAIL Cookie with %x8 in SameSite attribute value is handled correctly. assert_equals: The cookie was rejected. expected "" but got "test8samesite=t"
 FAIL Cookie with %x8 after SameSite attribute value is handled correctly. assert_equals: The cookie was rejected. expected "" but got "test8samesite2=t"
-PASS Cookie with %x9 in Domain attribute value is handled correctly.
+FAIL Cookie with %x9 in Domain attribute value is handled correctly. assert_equals: The cookie was set as expected. expected "test9domain=t" but got "test9domain=t; test8samesite2=t"
 PASS Cookie with %x9 after Domain attribute value is handled correctly.
 PASS Cookie with %x9 in Path attribute value is handled correctly.
 PASS Cookie with %x9 after Path attribute value is handled correctly.
Comment 1 Radar WebKit Bug Importer 2022-08-24 14:41:40 PDT
<rdar://problem/99104336>
Comment 2 Karl Rackler 2022-08-24 14:46:39 PDT
I have marked this test as a flaky failure while this issue is investigated.
Comment 3 EWS 2022-08-24 14:58:16 PDT
Test gardening commit 253743@main (d66e558d1369): <https://commits.webkit.org/253743@main>

Reviewed commits have been landed. Closing PR #3630 and removing active labels.