Bug 251219

Summary: [ macOS ] fast/images/animated-avif.html is broken
Product: WebKit Reporter: Robert Jenner <jenner>
Component: ImagesAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: ap, sabouhallawa, simon.fraser, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Robert Jenner 2023-01-26 11:51:54 PST
fast/images/animated-avif.html

is broken in multiple ways on macOS. 


For Ventura WK2 it is a constant timeout, and a flaky crash, but the flaky crash is being investigated on another bug. 

For Ventura WK1 it is a constant Imagefailure.

It is a constant ImageOnlyFailure on Monterey WK2, but only on systems running on Apple Silicon, so I wonder if we just need to adjust the pixel tolerances on that platform for apple silicon in order to fix that? 

HISTORY:
https://results.webkit.org/?suite=layout-tests&suite=layout-tests&suite=layout-tests&suite=layout-tests&test=fast%2Fimages%2Favif-as-image.html&test=fast%2Fimages%2Favif-heif-container-as-image.html&test=fast%2Fimages%2Favif-image-decoding.html&test=fast%2Fimages%2Favif-image-document.html


Image Diff link for Ventura WK1:
https://build.webkit.org/results/Apple-Ventura-Release-WK1-Tests/259363@main%20(1141)/fast/images/animated-avif-diffs.html

Image Diff link for Monterey WK2 Apple Silicon:
https://build.webkit.org/results/Apple-Monterey-Release-AppleSilicon-WK2-Tests/259363@main%20(7172)/fast/images/animated-avif-diffs.html

Expectations have already been set properly for this test.
Comment 1 Radar WebKit Bug Importer 2023-01-26 11:52:18 PST
<rdar://problem/104706388>
Comment 2 Robert Jenner 2023-01-26 12:10:33 PST
I can't reproduce the Timeout on Ventura WK2, but I am reproducing an ImageFailure. I believe this points to a test-list order issue, and I am investigating.
Comment 3 Robert Jenner 2023-01-26 13:51:00 PST
I cannot reproduce the timeout on Mac Ventura WK2, only an ImageOnly Failure. However, that does match what is occurring on Ventura wk1, and Monterey wk2 apple silicon. I reproduced the ImageOnlyFailure on my MacBookPro 18,3 at Ventura Debug ToT running the test as follows:


run-webkit-tests fast/images/animated-avif.html --force
Comment 4 Robert Jenner 2023-01-26 13:57:15 PST
According to the history the timeouts on Mac, and the timeouts on iOS for this test started occurring at or after 256665@main:

https://commits.webkit.org/256665@main


The difficulty here is that I can't reproduce the timeouts on Mac. But I can reproduce an ImageFailure.
Comment 5 Ryan Haddad 2023-05-08 13:35:52 PDT
Link to result history for fast/images/animated-avif.html: https://results.webkit.org/?suite=layout-tests&test=fast%2Fimages%2Fanimated-avif.html