Bug 244308 - Test addition (252580@main): [ macOS wk1 ] imported/w3c/web-platform-tests/cookies/attributes/attributes-ctl.sub.html is a flaky failure
Summary: Test addition (252580@main): [ macOS wk1 ] imported/w3c/web-platform-tests/co...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-08-24 14:41 PDT by Karl Rackler
Modified: 2022-08-29 10:15 PDT (History)
4 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Karl Rackler 2022-08-24 14:41:24 PDT 
Description:
imported/w3c/web-platform-tests/cookies/attributes/attributes-ctl.sub.html

The test is a resync web-platform-tests/cookies from upstream at 252580@main.  The test is consistently failing on iOS and flaky failing on macOS.  Test expectations are in place for wk2, but not wk1.

REPRODUCTION STEPS
I can reproduce this on 253735@main ToT.

Command: 
run-webkit-tests --root 253735@main -1 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 -f --no-retry imported/w3c/web-platform-tests/cookies/attributes/attributes-ctl.sub.html

Result: 
Unexpected flakiness: text-only failures (1)
  imported/w3c/web-platform-tests/cookies/attributes/attributes-ctl.sub.html [ Failure Pass ]

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcookies%2Fattributes%2Fattributes-ctl.sub.html&platform=mac&limit=50000&flavor=wk1

Diff:
--- /Volumes/Data/worker/Apple-Monterey-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/cookies/attributes/attributes-ctl.sub-expected.txt
+++ /Volumes/Data/worker/Apple-Monterey-Release-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/cookies/attributes/attributes-ctl.sub-actual.txt
@@ -116,7 +116,7 @@
 FAIL Cookie with %x8 in HttpOnly attribute is handled correctly. assert_equals: The cookie was rejected. expected "" but got "test8httponly=t"
 FAIL Cookie with %x8 in SameSite attribute value is handled correctly. assert_equals: The cookie was rejected. expected "" but got "test8samesite=t"
 FAIL Cookie with %x8 after SameSite attribute value is handled correctly. assert_equals: The cookie was rejected. expected "" but got "test8samesite2=t"
-PASS Cookie with %x9 in Domain attribute value is handled correctly.
+FAIL Cookie with %x9 in Domain attribute value is handled correctly. assert_equals: The cookie was set as expected. expected "test9domain=t" but got "test9domain=t; test8samesite2=t"
 PASS Cookie with %x9 after Domain attribute value is handled correctly.
 PASS Cookie with %x9 in Path attribute value is handled correctly.
 PASS Cookie with %x9 after Path attribute value is handled correctly.
Comment 1 Radar WebKit Bug Importer 2022-08-24 14:41:40 PDT 
<rdar://problem/99104336>
Comment 2 Karl Rackler 2022-08-24 14:46:39 PDT 
I have marked this test as a flaky failure while this issue is investigated.
Comment 3 EWS 2022-08-24 14:58:16 PDT 
Test gardening commit 253743@main (d66e558d1369): <https://commits.webkit.org/253743@main>

Reviewed commits have been landed. Closing PR #3630 and removing active labels.