Bug 206667

Summary: [iOS] legacy-animation-engine/animations/stop-animation-on-suspend.html is a flaky failure
Product: WebKit Reporter: Jason Lawrence <Lawrence.j>
Component: AnimationsAssignee: Nobody <webkit-unassigned>
Status: RESOLVED CONFIGURATION CHANGED    
Severity: Normal CC: dino, graouts, graouts, tsavell, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=49182
Attachments:
Description Flags
Update Test Expectations
none
Update Test Expectations none

Description Jason Lawrence 2020-01-23 09:25:03 PST 
legacy-animation-engine/animations/stop-animation-on-suspend.html

Description:
This test is flaky failing on iOS release.

History:
https://results.webkit.org/?suite=layout-tests&test=legacy-animation-engine%2Fanimations%2Fstop-animation-on-suspend.html

Diff:
--- /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/legacy-animation-engine/animations/stop-animation-on-suspend-expected.txt
+++ /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/legacy-animation-engine/animations/stop-animation-on-suspend-actual.txt
@@ -1,6 +1,6 @@
 
 PASS - "webkitTransform" property for "box" element at 0.2s saw something close to: 1,0,0,1,100,0
 PASS - "webkitTransform" property for "iframe.subframe-box" element at 0.2s saw something close to: 1,0,0,1,100,0
-PASS - "webkitTransform" property for "box" element at 0.4s saw something close to: 1,0,0,1,200,0
-PASS - "webkitTransform" property for "iframe.subframe-box" element at 0.4s saw something close to: 1,0,0,1,200,0
+FAIL - "webkitTransform" property for "box" element at 0.4s expected: 1,0,0,1,200,0 but saw: matrix(1, 0, 0, 1, 126.72084045410156, 0)
+FAIL - "webkitTransform" property for "iframe.subframe-box" element at 0.4s expected: 1,0,0,1,200,0 but saw: matrix(1, 0, 0, 1, 126.85371398925781, 0)
Comment 1 Alexey Proskuryakov 2020-01-24 22:58:30 PST 
This test is marked as flaky on macOS, see bug 49182. It is curious that failures are most common on iOS Release, but scrolling back in history, I see them on debug too.

This is not a new regression.
Comment 2 Jason Lawrence 2020-01-27 14:10:53 PST 
Created attachment 388907 [details]
Update Test Expectations
Comment 3 Jason Lawrence 2020-01-27 14:27:06 PST 
Created attachment 388911 [details]
Update Test Expectations
Comment 4 Truitt Savell 2020-01-27 14:29:28 PST 
Comment on attachment 388911 [details]
Update Test Expectations

Clearing flags on attachment: 388911

Committed r255177: <https://trac.webkit.org/changeset/255177>
Comment 5 Jason Lawrence 2020-01-28 14:36:30 PST 
I was able to reproduce this issue locally by running the following command: ’run-webkit-tests legacy-animation-engine/animations/stop-animation-on-suspend.html --iterations 5000 -f --ios-simulator’
4994 tested ran as expected, 6 didn’t.
Comment 6 Antoine Quint 2020-03-09 12:56:20 PDT 
This test is gone as of r258150, see bug 208815.
Comment 7 Radar WebKit Bug Importer 2020-03-09 12:57:15 PDT 
<rdar://problem/60238048>