Bug 243836

Summary:	New test: [ iOS16 ] imported/w3c/web-platform-tests/css/css-flexbox/negative-overflow-002.html is a constant failure
Product:	WebKit	Reporter:	Hercules Hjalmarsson <hhjalmarsson>
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED FIXED
Severity:	Normal	CC:	ntim, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Hercules Hjalmarsson 2022-08-11 11:34:42 PDT

imported/w3c/web-platform-tests/css/css-flexbox/negative-overflow-002.html

Is a constant text failure on iOS ToT and since it was introduced at 253170@main.

HISTORY:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fcss%2Fcss-flexbox%2Fnegative-overflow-002.html

DIFF:
--- /Volumes/Data/worker/Apple-iPadOS-15-Simulator-Release-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/css/css-flexbox/negative-overflow-002-expected.txt
+++ /Volumes/Data/worker/Apple-iPadOS-15-Simulator-Release-WK2-Tests/build/layout-test-results/imported/w3c/web-platform-tests/css/css-flexbox/negative-overflow-002-actual.txt
@@ -245,13 +245,13 @@
 scrollWidth expected 370 but got 105
 FAIL .container 13 assert_equals:
 <div class="container" data-expected-scroll-width="370" data-expected-scroll-height="130" style="writing-mode: horizontal-tb; direction: rtl; flex-flow: row nowrap;"><div class="item">1</div><div class="item">2</div><div class="item">3</div></div>
-scrollWidth expected 370 but got 360
+scrollWidth expected 370 but got 345
 FAIL .container 14 assert_equals:
 <div class="container" data-expected-scroll-width="130" data-expected-scroll-height="370" style="writing-mode: horizontal-tb; direction: rtl; flex-flow: row wrap;"><div class="item">1</div><div class="item">2</div><div class="item">3</div></div>
-scrollWidth expected 130 but got 120
+scrollWidth expected 130 but got 105
 FAIL .container 15 assert_equals:
 <div class="container" data-expected-scroll-width="130" data-expected-scroll-height="370" style="writing-mode: horizontal-tb; direction: rtl; flex-flow: row wrap-reverse;"><div class="item">1</div><div class="item">2</div><div class="item">3</div></div>
-scrollWidth expected 130 but got 120
+scrollWidth expected 130 but got 105
 FAIL .container 16 assert_equals:
 <div class="container" data-expected-scroll-width="370" data-expected-scroll-height="130" style="writing-mode: horizontal-tb; direction: rtl; flex-flow: row-reverse nowrap;"><div class="item">1</div><div class="item">2</div><div class="item">3</div></div>
 scrollWidth expected 370 but got 105
@@ -263,19 +263,19 @@
 scrollWidth expected 130 but got 105
 FAIL .container 19 assert_equals:
 <div class="container" data-expected-scroll-width="130" data-expected-scroll-height="370" style="writing-mode: horizontal-tb; direction: rtl; flex-flow: column nowrap;"><div class="item">1</div><div class="item">2</div><div class="item">3</div></div>
-scrollWidth expected 130 but got 120
+scrollWidth expected 130 but got 105
 FAIL .container 20 assert_equals:
 <div class="container" data-expected-scroll-width="370" data-expected-scroll-height="130" style="writing-mode: horizontal-tb; direction: rtl; flex-flow: column wrap;"><div class="item">1</div><div class="item">2</div><div class="item">3</div></div>
-scrollWidth expected 370 but got 360
+scrollWidth expected 370 but got 345
 FAIL .container 21 assert_equals:
 <div class="container" data-expected-scroll-width="370" data-expected-scroll-height="130" style="writing-mode: horizontal-tb; direction: rtl; flex-flow: column wrap-reverse;"><div class="item">1</div><div class="item">2</div><div class="item">3</div></div>
 scrollWidth expected 370 but got 105
 FAIL .container 22 assert_equals:
 <div class="container" data-expected-scroll-width="130" data-expected-scroll-height="370" style="writing-mode: horizontal-tb; direction: rtl; flex-flow: column-reverse nowrap;"><div class="item">1</div><div class="item">2</div><div class="item">3</div></div>
-scrollWidth expected 130 but got 120
+scrollWidth expected 130 but got 105
 FAIL .container 23 assert_equals:
 <div class="container" data-expected-scroll-width="370" data-expected-scroll-height="130" style="writing-mode: horizontal-tb; direction: rtl; flex-flow: column-reverse wrap;"><div class="item">1</div><div class="item">2</div><div class="item">3</div></div>
-scrollWidth expected 370 but got 360
+scrollWidth expected 370 but got 345
 FAIL .container 24 assert_equals:
 <div class="container" data-expected-scroll-width="370" data-expected-scroll-height="130" style="writing-mode: horizontal-tb; direction: rtl; flex-flow: column-reverse wrap-reverse;"><div class="item">1</div><div class="item">2</div><div class="item">3</div></div>
 scrollWidth expected 370 but got 105

DIFF URL:
https://build.webkit.org/results/Apple-iPadOS-15-Simulator-Release-WK2-Tests/253171@main%20(2265)/imported/w3c/web-platform-tests/css/css-flexbox/negative-overflow-002-pretty-diff.html

Comment 1 Radar WebKit Bug Importer 2022-08-11 11:35:10 PDT

<rdar://problem/98520356>

Comment 2 Hercules Hjalmarsson 2022-08-11 11:43:19 PDT

I was able to reproduce this issue at 253170@main and ToT running command:

run-webkit-tests --ios-simulator imported/w3c/web-platform-tests/css/css-flexbox/negative-overflow-002.html

However, needed to download the iOS build similar to the bots.

Comment 3 EWS 2022-08-11 11:44:35 PDT

Test gardening commit 253344@main (daef9fc001b8): <https://commits.webkit.org/253344@main>

Reviewed commits have been landed. Closing PR #3232 and removing active labels.

Comment 4 Tim Nguyen (:ntim) 2022-08-23 09:11:36 PDT

Rebaselining here is fine thanks!

Comment 5 EWS 2022-10-20 16:54:02 PDT

Test gardening commit 255808@main (70f11766aa56): <https://commits.webkit.org/255808@main>

Reviewed commits have been landed. Closing PR #5608 and removing active labels.

Comment 6 Hercules Hjalmarsson 2022-10-20 16:54:34 PDT

(In reply to EWS from comment #5)
> Test gardening commit 255808@main (70f11766aa56):
> <https://commits.webkit.org/255808@main>
> 
> Reviewed commits have been landed. Closing PR #5608 and removing active
> labels.

Re-baselined test for iOS in above commit.