Bug 214139

Summary: [ iOS WK2 ] imported/w3c/web-platform-tests/html/rendering/replaced-elements/attributes-for-embedded-content-and-images/img-aspect-ratio-lazy.tentative.html is a flaky failure
Product: WebKit Reporter: Karl Rackler <rackler>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: rackler, tsavell, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=214173

Description Karl Rackler 2020-07-09 08:32:39 PDT
imported/w3c/web-platform-tests/html/rendering/replaced-elements/attributes-for-embedded-content-and-images/img-aspect-ratio-lazy.tentative.html

Description:
The test is flaky failing on iOS WK2 release. It has been flaky failing since introduced.

History: 
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Frendering%2Freplaced-elements%2Fattributes-for-embedded-content-and-images%2Fimg-aspect-ratio-lazy.tentative.html&limit=50000&platform=ios&style=release&flavor=wk2

Diff: 
--- /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/rendering/replaced-elements/attributes-for-embedded-content-and-images/img-aspect-ratio-lazy.tentative-expected.txt
+++ /Volumes/Data/slave/ios-simulator-13-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/rendering/replaced-elements/attributes-for-embedded-content-and-images/img-aspect-ratio-lazy.tentative-actual.txt
@@ -1,4 +1,4 @@
 
 
-PASS Image width and height attributes are used to infer aspect-ratio for lazy-loaded images 
+FAIL Image width and height attributes are used to infer aspect-ratio for lazy-loaded images assert_approx_equals: expected 1 +/- 0.001 but got 2
Comment 1 Radar WebKit Bug Importer 2020-07-09 08:33:09 PDT
<rdar://problem/65272657>
Comment 2 Karl Rackler 2020-07-09 08:39:57 PDT
I can reproduce this on r264166 as well as going back to r256790.

Commit: r264166

Command: 
run-webkit-tests --ios-simulator --iterations 500 --exit-after-n-failures 3 --debug --force -f imported/w3c/web-platform-tests/html/rendering/replaced-elements/attributes-for-embedded-content-and-images/img-aspect-ratio-lazy.tentative.html

Result: 
[9/500] imported/w3c/web-platform-tests/html/rendering/replaced-elements/attributes-for-embedded-content-and-images/img-aspect-ratio-lazy.tentative.html failed unexpectedly (text diff)
[9/500] imported/w3c/web-platform-tests/html/rendering/replaced-elements/attributes-for-embedded-content-and-images/img-aspect-ratio-lazy.tentative.html failed unexpectedly (text diff)
[9/500] imported/w3c/web-platform-tests/html/rendering/replaced-elements/attributes-for-embedded-content-and-images/img-aspect-ratio-lazy.tentative.html failed unexpectedly (text diff)
Exiting early after 3 failures. 7 tests run.


4 tests ran as expected, 3 didn't (493 didn't run):


Regressions: Unexpected text-only failures (1)
  imported/w3c/web-platform-tests/html/rendering/replaced-elements/attributes-for-embedded-content-and-images/img-aspect-ratio-lazy.tentative.html [ Failure ]
Comment 3 Truitt Savell 2020-07-10 13:54:36 PDT
This was a test that was re-synced in https://trac.webkit.org/changeset/264117/webkit

it is currently failing for iOS and Mac. it currently has expectations on Mac wk1 but needs expectations on wk2