Bug 239990

Summary:	[ iOS ][ macOS ] css3/calc/transitions-dependent.html is a flaky failure
Product:	WebKit	Reporter:	Karl Rackler <rackler>
Component:	Animations	Assignee:	Karl Rackler <rackler>
Status:	NEW ---
Severity:	Normal	CC:	dino, graouts, koivisto, simon.fraser, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=126142

Description Karl Rackler 2022-05-02 16:37:45 PDT

Description:
css3/calc/transitions-dependent.html

The iOS test on 1/11/2022 at r287874 improved the constant failure to passing on iOS until 3/21/2022 at r291584 where it becomes a flaky failure. 
 
The first failure that I saw on the dashboard for Big Sur was 2/15/2022 at r289815, but this does not appear relevant to causing this issue.  The first failure that I saw on the dashboard for Monterey was 2/15/2022 at r289815.

REPRODUCTION STEPS
I can reproduce this on Tot (r293682), but unable to reproduce to find the regression point.  Also, note you can run this without --iterations and it passes for iOS, but fails with the it.
i.e. 
run-webkit-tests --root 293682 --ios-simulator --device-type iPhone 12 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 css3/calc/transitions-dependent.html = Passes
run-webkit-tests --root 293682 --ios-simulator --device-type iPhone 12 --iterations 2 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 css3/calc/transitions-dependent.html = Failure

[iOS]
Command:
run-webkit-tests --root 293682 --ios-simulator --device-type iPhone 12 --iterations 2 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 css3/calc/transitions-dependent.html = Failure

Result: 
[2/2] css3/calc/transitions-dependent.html failed unexpectedly (text diff)
Exiting early after 2 failures. 2 tests run.

0 tests ran as expected, 2 didn't:

Unexpected flakiness: text-only failures (1)
  css3/calc/transitions-dependent.html [ Failure Pass ]

[macOS]
Command:
run-webkit-tests --root 293682 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 -f --no-retry css3/calc/transitions-dependent.html

Result: 
8 tests ran as expected, 3 didn't (39 didn't run):


Unexpected flakiness: text-only failures (1)
  css3/calc/transitions-dependent.html [ Failure Pass ] 

History:
https://results.webkit.org/?suite=layout-tests&test=css3%2Fcalc%2Ftransitions-dependent.html&platform=mac&platform=ios&limit=50000

Diff:
--- /Volumes/Data/worker/Apple-Monterey-Debug-WK1-Tests/build/layout-test-results/css3/calc/transitions-dependent-expected.txt
+++ /Volumes/Data/worker/Apple-Monterey-Debug-WK1-Tests/build/layout-test-results/css3/calc/transitions-dependent-actual.txt
@@ -1,12 +1,22 @@
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
+CONSOLE MESSAGE: A transition for property width could not be found
 This tests that calc() expressions depending on transitioning elements behave correctly.
-PASS - "width" property for "inner" element at 0s was: 60
-PASS - "width" property for "inner" element at 0.25s was: 110
-PASS - "width" property for "inner" element at 0.5s was: 160
-PASS - "width" property for "inner" element at 0.75s was: 210
+FAIL - "width" property for "inner" element at 0s expected: 60 but saw: 260
+FAIL - "width" property for "inner" element at 0.25s expected: 110 but saw: 260
+FAIL - "width" property for "inner" element at 0.5s expected: 160 but saw: 260
+FAIL - "width" property for "inner" element at 0.75s expected: 210 but saw: 260
 PASS - "width" property for "inner" element at 1s was: 260
-PASS - "width" property for "innerTransition" element at 0s was: 60
-PASS - "width" property for "innerTransition" element at 0.25s was: 167.5
-PASS - "width" property for "innerTransition" element at 0.5s was: 275
-PASS - "width" property for "innerTransition" element at 0.75s was: 382.5
+FAIL - "width" property for "innerTransition" element at 0s expected: 60 but saw: 490
+FAIL - "width" property for "innerTransition" element at 0.25s expected: 167.5 but saw: 490
+FAIL - "width" property for "innerTransition" element at 0.5s expected: 275 but saw: 490
+FAIL - "width" property for "innerTransition" element at 0.75s expected: 382.5 but saw: 490
 PASS - "width" property for "innerTransition" element at 1s was: 490

Comment 1 Radar WebKit Bug Importer 2022-05-02 16:38:47 PDT

<rdar://problem/92640544>

Comment 2 Karl Rackler 2022-05-02 16:59:05 PDT

I have marked this test as a flaky failure this issue is investigated.

Comment 3 Karl Rackler 2022-05-02 17:02:41 PDT

Pull request: https://github.com/WebKit/WebKit/pull/462

Comment 4 EWS 2022-05-02 17:05:18 PDT

Test gardening commit r293702 (250193@main): <https://commits.webkit.org/250193@main>

Reviewed commits have been landed. Closing PR #462 and removing active labels.

Comment 5 Karl Rackler 2022-05-03 13:33:48 PDT

Pull request: https://github.com/WebKit/WebKit/pull/476

Comment 6 Karl Rackler 2022-05-03 13:37:07 PDT

(In reply to Karl Rackler from comment #5)
> Pull request: https://github.com/WebKit/WebKit/pull/476

This was not meant for this bug, please disregard.