Bug 207141 - REGRESSION: [ macOS wk2 ] inspector/canvas/create-context-bitmaprenderer.html is flaky failing
Summary: REGRESSION: [ macOS wk2 ] inspector/canvas/create-context-bitmaprenderer.html...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Canvas (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-02-03 13:24 PST by Jacob Uphoff
Modified: 2021-07-09 15:31 PDT (History)
4 users (show)

See Also:

Attachments
Update Test Expectations (1.45 KB, patch)
2020-02-03 13:29 PST, Jacob Uphoff 		no flags Details | Formatted Diff | Diff
View All Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Jacob Uphoff 2020-02-03 13:24:52 PST 
inspector/canvas/create-context-bitmaprenderer.html

This test has been flaky failing and the first failure was seen on commit 254517 so it probably regressed around there

I ran the test in iterations x5000 and did not reproduce the failure 

History:
https://results.webkit.org/?suite=layout-tests&test=inspector%2Fcanvas%2Fcreate-context-bitmaprenderer.html&limit=50000&platform=ios&platform=mac

Diff:

--- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-expected.txt
+++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-actual.txt
@@ -25,5 +25,5 @@
   4: (anonymous function) - [native code]
   5: _wrapCall - [native code]
 
-PASS: Removed canvas has expected ID.
+!! TIMEOUT: took longer than 10000ms
Comment 1 Jacob Uphoff 2020-02-03 13:28:44 PST 
Seems to only be affecting release at this time
Comment 2 Jacob Uphoff 2020-02-03 13:29:01 PST 
Created attachment 389551 [details]
Update Test Expectations
Comment 3 Radar WebKit Bug Importer 2020-02-03 13:32:37 PST 
<rdar://problem/59123309>
Comment 4 Truitt Savell 2020-02-03 13:33:10 PST 
Comment on attachment 389551 [details]
Update Test Expectations

Clearing flags on attachment: 389551

Committed r255585: <https://trac.webkit.org/changeset/255585>
Comment 5 Ryan Haddad 2021-07-09 15:21:49 PDT 
This test is still a flaky failure, seems to be limited to debug bots:

--- /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-expected.txt
+++ /Volumes/Data/worker/macOS-AppleSilicon-Big-Sur-Debug-WK2-Tests-EWS/build/layout-test-results/inspector/canvas/create-context-bitmaprenderer-actual.txt
@@ -14,7 +14,7 @@
   4: (anonymous function) - [native code]
   5: _wrapCall - [native code]
 
-PASS: Removed canvas has expected ID.
+!! TIMEOUT: took longer than 10000ms
 
 -- Running test case: Canvas.CreateContextBitmapRenderer.Detached
 PASS: Canvas context should be Bitmap Renderer.
@@ -25,5 +25,8 @@
   4: (anonymous function) - [native code]
   5: _wrapCall - [native code]
 
+FAIL: Removed canvas has expected ID.
+    Expected: "canvas:0.76"
+    Actual: "canvas:0.77"
 PASS: Removed canvas has expected ID.
Comment 6 Ryan Haddad 2021-07-09 15:31:15 PDT 
Updated expectations to reflect that this is debug only now in https://trac.webkit.org/changeset/279798/webkit