Bug 244538 - Test addition (247271@main): [ macOS wk1 Debug ] imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-margin-003.html is a flaky image failure
Summary: Test addition (247271@main): [ macOS wk1 Debug ] imported/w3c/web-platform-te...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-08-30 08:10 PDT by Karl Rackler
Modified: 2022-08-30 08:29 PDT (History)
3 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Karl Rackler 2022-08-30 08:10:41 PDT 
Description:
imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-margin-003.html

This test was added at 230283@main and was a consistent image failure until, at 247271@main, it began to flaky image fail.

REPRODUCTION STEPS
I can reproduce this on 253939@main ToT.

Command: 
run-webkit-tests --debug -1 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 -f --no-retry imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-margin-003.html

Result: 
Unexpected flakiness: image-only failures (1)
  imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-margin-003.html [ Pass ImageOnlyFailure ]

History:
https://results.webkit.org/?limit=50000&suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-scroll-snap%2Fscroll-target-margin-003.html&platform=mac&style=debug&flavor=wk1&recent=false

Image Diff:
https://build.webkit.org/results/Apple-Monterey-Debug-WK1-Tests/253917@main%20(3371)/imported/w3c/web-platform-tests/css/css-scroll-snap/scroll-target-margin-003-diffs.html
Comment 1 Radar WebKit Bug Importer 2022-08-30 08:11:03 PDT 
<rdar://problem/99331640>
Comment 2 Karl Rackler 2022-08-30 08:24:31 PDT 
I have marked this test as a flaky image failure while this issue is investigated.
Comment 3 EWS 2022-08-30 08:29:43 PDT 
Test gardening commit 253944@main (383176abb289): <https://commits.webkit.org/253944@main>

Reviewed commits have been landed. Closing PR #3808 and removing active labels.