Bug 244736 - REGRESSION (246057@main): [ macOS wk1 ] imported/w3c/web-platform-tests/video-rvfc/request-video-frame-callback.html is a flaky failure
Summary: REGRESSION (246057@main): [ macOS wk1 ] imported/w3c/web-platform-tests/video...
Status: RESOLVED FIXED
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Jer Noble
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-09-02 15:51 PDT by Karl Rackler
Modified: 2022-11-18 11:53 PST (History)
3 users (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Karl Rackler 2022-09-02 15:51:46 PDT 
Description:
imported/w3c/web-platform-tests/video-rvfc/request-video-frame-callback.html

This test was added at 243270@main and consistently passed until 246057@main, when it began to flaky fail.

REPRODUCTION STEPS
I can reproduce this on 254109@main ToT.

Command: 
run-webkit-tests --debug --root 254109@main-debug -1 --exit-after-n-failures 1 --exit-after-n-crashes-or-timeouts 1 --iterations 50 -f --no-retry imported/w3c/web-platform-tests/video-rvfc/request-video-frame-callback.html

Result: 
Unexpected flakiness: text-only failures (1)
  imported/w3c/web-platform-tests/video-rvfc/request-video-frame-callback.html [ Failure Pass ]

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fvideo-rvfc%2Frequest-video-frame-callback.html&platform=mac&flavor=wk1&limit=50000&recent=false

Diff:
--- /Volumes/Data/worker/Apple-Monterey-Debug-AppleSilicon-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/video-rvfc/request-video-frame-callback-expected.txt
+++ /Volumes/Data/worker/Apple-Monterey-Debug-AppleSilicon-WK1-Tests/build/layout-test-results/imported/w3c/web-platform-tests/video-rvfc/request-video-frame-callback-actual.txt
@@ -1,8 +1,10 @@
 
+
+Harness Error (TIMEOUT), message = null
 
 PASS Test we can register a video.rVFC callback.
 PASS Test video.rVFC callbacks run before window.rAF callbacks.
 PASS Test we can cancel a video.rVFC request.
 PASS Test invalid calls to the video.rVFC API.
-PASS Test video.rVFC does not stop when switching sources.
+TIMEOUT Test video.rVFC does not stop when switching sources. Test timed out
Comment 1 Radar WebKit Bug Importer 2022-09-02 15:52:04 PDT 
<rdar://problem/99507721>
Comment 2 Karl Rackler 2022-09-02 15:55:23 PDT 
I have marked this test as a flaky failure while this issue is investigated.
Comment 3 EWS 2022-09-02 16:03:17 PDT 
Test gardening commit 254118@main (baf9e11f3a46): <https://commits.webkit.org/254118@main>

Reviewed commits have been landed. Closing PR #3974 and removing active labels.
Comment 4 Jer Noble 2022-11-17 16:02:16 PST 
Pull request: https://github.com/WebKit/WebKit/pull/6610
Comment 5 EWS 2022-11-18 11:53:55 PST 
Committed 256846@main (34a5a7308d8a): <https://commits.webkit.org/256846@main>

Reviewed commits have been landed. Closing PR #6610 and removing active labels.