Bug 244736

Summary: REGRESSION (246057@main): [ macOS wk1 ] imported/w3c/web-platform-tests/video-rvfc/request-video-frame-callback.html is a flaky failure
Product: WebKit Reporter: Karl Rackler <rackler>
Component: New BugsAssignee: Jer Noble <jer.noble>
Status: RESOLVED FIXED    
Severity: Normal CC: jer.noble, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Karl Rackler 2022-09-02 15:51:46 PDT
Description:
imported/w3c/web-platform-tests/video-rvfc/request-video-frame-callback.html

This test was added at 243270@main and consistently passed until 246057@main, when it began to flaky fail.

REPRODUCTION STEPS
I can reproduce this on 254109@main ToT.

Command: 
run-webkit-tests --debug --root 254109@main-debug -1 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 -f --no-retry imported/w3c/web-platform-tests/video-rvfc/request-video-frame-callback.html

Result: 
Unexpected flakiness: text-only failures (1)
  imported/w3c/web-platform-tests/video-rvfc/request-video-frame-callback.html [ Failure Pass ]

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fvideo-rvfc%2Frequest-video-frame-callback.html&platform=mac&flavor=wk1&limit=50000&recent=false

Diff:
--- /Volumes/Data/worker/Apple-Monterey-Debug-AppleSilicon-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/video-rvfc/request-video-frame-callback-expected.txt
+++ /Volumes/Data/worker/Apple-Monterey-Debug-AppleSilicon-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/video-rvfc/request-video-frame-callback-actual.txt
@@ -1,8 +1,10 @@
 
+
+Harness Error (TIMEOUT), message = null
 
 PASS Test we can register a video.rVFC callback.
 PASS Test video.rVFC callbacks run before window.rAF callbacks.
 PASS Test we can cancel a video.rVFC request.
 PASS Test invalid calls to the video.rVFC API.
-PASS Test video.rVFC does not stop when switching sources.
+TIMEOUT Test video.rVFC does not stop when switching sources. Test timed out
Comment 1 Radar WebKit Bug Importer 2022-09-02 15:52:04 PDT
<rdar://problem/99507721>
Comment 2 Karl Rackler 2022-09-02 15:55:23 PDT
I have marked this test as a flaky failure while this issue is investigated.
Comment 3 EWS 2022-09-02 16:03:17 PDT
Test gardening commit 254118@main (baf9e11f3a46): <https://commits.webkit.org/254118@main>

Reviewed commits have been landed. Closing PR #3974 and removing active labels.
Comment 4 Jer Noble 2022-11-17 16:02:16 PST
Pull request: https://github.com/WebKit/WebKit/pull/6610
Comment 5 EWS 2022-11-18 11:53:55 PST
Committed 256846@main (34a5a7308d8a): <https://commits.webkit.org/256846@main>

Reviewed commits have been landed. Closing PR #6610 and removing active labels.