Bug 208519 - REGRESSION (r257756?) [ Catalina ] webanimations/accelerated-animation-slot-invalidation.html is flaky failing.
Summary: REGRESSION (r257756?) [ Catalina ] webanimations/accelerated-animation-slot-i...
Status: RESOLVED INVALID
Alias: None
Product: WebKit
Classification: Unclassified
Component: Animations (show other bugs)
Version: WebKit Nightly Build
Hardware: Mac macOS 10.15
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-03-03 09:39 PST by Jason Lawrence
Modified: 2020-03-03 12:59 PST (History)
0 users

See Also:


Attachments
accelerated-animation-slot-invalidation-diff (2.55 KB, image/png)
2020-03-03 09:39 PST, Jason Lawrence
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Jason Lawrence 2020-03-03 09:39:50 PST
Created attachment 392286 [details]
accelerated-animation-slot-invalidation-diff

webanimations/accelerated-animation-slot-invalidation.html

Description:
This test is flaky failing on Catalina. The oldest failure that I see is on r257025, but I am not able to locate a diff for that failure.

History:
https://results.webkit.org/?suite=layout-tests&test=webanimations%2Faccelerated-animation-slot-invalidation.html&platform=mac&version_name=Catalina&style=debug&style=release

Diff:
https://build.webkit.org/results/Apple-Catalina-Debug-WK1-Tests/r257778%20(2849)/webanimations/accelerated-animation-slot-invalidation-diff.png
Comment 1 Radar WebKit Bug Importer 2020-03-03 09:40:09 PST
<rdar://problem/59999868>
Comment 2 Radar WebKit Bug Importer 2020-03-03 09:47:27 PST
<rdar://problem/60000347>
Comment 3 Jason Lawrence 2020-03-03 09:50:35 PST
I have marked this as failing the image test while this issue is investigated.
https://trac.webkit.org/changeset/257782/webkit
Comment 4 Radar WebKit Bug Importer 2020-03-03 09:50:44 PST
<rdar://problem/60000486>
Comment 5 Jason Lawrence 2020-03-03 11:20:24 PST
I can reproduce this issue on r257778 by running the command below.
run-webkit-tests --iterations 2000 --exit-after-n-failures 3 --force webanimations/accelerated-animation-slot-invalidation.html

[1/2000] webanimations/accelerated-animation-slot-invalidation.html failed unexpectedly (com.apple.WebKit.Networking.Development crashed [pid=92312])
[2/2000] webanimations/accelerated-animation-slot-invalidation.html failed unexpectedly (com.apple.WebKit.Networking.Development crashed [pid=92565])
[3/2000] webanimations/accelerated-animation-slot-invalidation.html failed unexpectedly (com.apple.WebKit.Networking.Development crashed [pid=92742])
Exiting early after 3 failures. 3 tests run.


0 tests ran as expected, 3 didn't (1997 didn't run):
Comment 6 Jason Lawrence 2020-03-03 11:48:23 PST
when using the same command, I can see that the issue starts between r257759 & r257747.

r257759:
[1/1000] webanimations/accelerated-animation-slot-invalidation.html failed unexpectedly (com.apple.WebKit.Networking.Development crashed [pid=39617])
[2/1000] webanimations/accelerated-animation-slot-invalidation.html failed unexpectedly (com.apple.WebKit.Networking.Development crashed [pid=39633])
[3/1000] webanimations/accelerated-animation-slot-invalidation.html failed unexpectedly (com.apple.WebKit.Networking.Development crashed [pid=39649])
Exiting early after 3 failures. 3 tests run.
0 tests ran as expected, 3 didn't (997 didn't run):

r257747:
All 1000 tests ran as expected.
Comment 7 Jason Lawrence 2020-03-03 11:55:52 PST
Correction. I was not able to reproduce the failures, I could not locate a diff on the results page and did not get a crash log locally. 
There does appear to be an issue that's likely related to r257756.
Comment 8 Jason Lawrence 2020-03-03 12:59:19 PST
Marking as invalid and creating a new bug, if needed