Bug 209619

Summary: [ macOS iOS ] compositing/clipping/border-radius-async-overflow-stacking.html is flaky failing.
Product: WebKit Reporter: Jason Lawrence <Lawrence.j>
Component: CompositingAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: hector_i_lopez, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Mac   
OS: macOS 10.15   
Attachments:
Description Flags
border-radius-async-overflow-stacking-diff
none
Diff Image 09/09/2020
none
Expected Image 09/09/2020
none
Actual Image 09/09/2020 none

Description Jason Lawrence 2020-03-26 13:39:42 PDT
compositing/clipping/border-radius-async-overflow-stacking.html

Description:
This test is flaky failing on Catalina. The flaky failures are apparent throughout the visible history.

History:
https://results.webkit.org/?suite=layout-tests&test=compositing%2Fclipping%2Fborder-radius-async-overflow-stacking.html&platform=mac&version_name=Catalina&limit=50000

Diff:
https://build.webkit.org/results/Apple-Catalina-Release-WK2-Tests/r259063%20(4109)/compositing/clipping/border-radius-async-overflow-stacking-diffs.html
Comment 1 Radar WebKit Bug Importer 2020-03-26 13:40:05 PDT
<rdar://problem/60934034>
Comment 2 Jason Lawrence 2020-03-26 13:41:52 PDT
I am able to reproduce this issue with the following command.
run-webkit-tests --iterations 2000 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --debug-rwt-logging --no-retry --force --no-build -f compositing/clipping/border-radius-async-overflow-stacking.html
Comment 3 Jason Lawrence 2020-03-26 13:46:24 PDT
Created attachment 394656 [details]
border-radius-async-overflow-stacking-diff
Comment 4 Jason Lawrence 2020-03-26 13:49:13 PDT
I have marked this test as failing while this issue is investigated.
https://trac.webkit.org/changeset/259075/webkit
Comment 5 Hector Lopez 2020-09-09 17:22:44 PDT
Created attachment 408386 [details]
Diff Image 09/09/2020
Comment 6 Hector Lopez 2020-09-09 17:24:00 PDT
Created attachment 408387 [details]
Expected Image 09/09/2020
Comment 7 Hector Lopez 2020-09-09 17:24:31 PDT
Created attachment 408388 [details]
Actual Image 09/09/2020
Comment 8 Hector Lopez 2020-09-09 17:31:13 PDT
Test is very inconsistently flaky on macOS Catalina but now also flaky on BigSur+. Test is also flaky in iOS wk2. First occurrence of failure on iOS is at r262354 and on macOS Catalina from r262354. 

History:
https://results.webkit.org/?suite=layout-tests&test=compositing%2Fclipping%2Fborder-radius-async-overflow-stacking.html&limit=50000&platform=ios&platform=mac

Diff is different than before but not by much, difference now is 7 pixels. Please see attached. Will check if a re-baseline is in order.

Test expectation changes:

https://trac.webkit.org/changeset/266807/webkit