Bug 217857

Summary:	REGRESSION (r262708): [ Mojave debug wk2 ] imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop.html is a constant failure
Product:	WebKit	Reporter:	Karl Rackler <rackler>
Component:	New Bugs	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED CONFIGURATION CHANGED
Severity:	Normal	CC:	webkit-bot-watchers-bugzilla, webkit-bug-importer, youennf
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Karl Rackler 2020-10-16 16:49:09 PDT

Description:
imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop.html

The first failure in the series of constant failures that I see this on the dashboard was 06/08/20 at r262708. It has to do with using AVAssetWriterDelegate to implement MediaRecorder, which could have introduced the consistent failures. The change was introduced here https://trac.webkit.org/changeset/262708/webkit.

I was unable to reproduce the failure due to the lack of spades in that range.

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fmediacapture-record%2FMediaRecorder-stop.html&limit=50000&version_name=Mojave&flavor=wk2&style=debug

Diff Log:
--- /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop-expected.txt
+++ /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/mediacapture-record/MediaRecorder-stop-actual.txt
@@ -1,9 +1,9 @@
 
-PASS MediaRecorder will stop recording and fire a stop event when all tracks are ended
-PASS MediaRecorder will stop recording and fire a stop event when stop() is called
+FAIL MediaRecorder will stop recording and fire a stop event when all tracks are ended promise_test: Unhandled rejection with value: object "NotSupportedError: The MediaRecorder is unsupported on this platform"
+FAIL MediaRecorder will stop recording and fire a stop event when stop() is called promise_test: Unhandled rejection with value: object "NotSupportedError: The MediaRecorder is unsupported on this platform"
 PASS MediaRecorder will not fire an exception when stopped after creation
-PASS MediaRecorder will not fire an exception when stopped after having just been stopped
-PASS MediaRecorder will not fire an exception when stopped after having just been spontaneously stopped
-PASS MediaRecorder will fire start event even if stopped synchronously
-PASS MediaRecorder will fire start event even if a track is removed synchronously
+FAIL MediaRecorder will not fire an exception when stopped after having just been stopped promise_test: Unhandled rejection with value: object "NotSupportedError: The MediaRecorder is unsupported on this platform"
+FAIL MediaRecorder will not fire an exception when stopped after having just been spontaneously stopped promise_test: Unhandled rejection with value: object "NotSupportedError: The MediaRecorder is unsupported on this platform"
+FAIL MediaRecorder will fire start event even if stopped synchronously promise_test: Unhandled rejection with value: object "NotSupportedError: The MediaRecorder is unsupported on this platform"
+FAIL MediaRecorder will fire start event even if a track is removed synchronously promise_test: Unhandled rejection with value: object "NotSupportedError: The MediaRecorder is unsupported on this platform"

Comment 1 Radar WebKit Bug Importer 2020-10-16 16:49:34 PDT

<rdar://problem/70397075>

Comment 2 Karl Rackler 2020-10-16 17:07:47 PDT

I have marked this test as skip while this issue is investigated.
https://trac.webkit.org/changeset/268621/webkit

Comment 3 youenn fablet 2020-10-26 03:39:15 PDT

MediaRecorder is not supported in Mojave, so we just need to rebase the test expectation or skip it.
We skip all media recorder tests for Mojave by default but this might be overridden by other expectation lines.
Karl expectation update seems fine to me.

Comment 4 Karl Rackler 2020-10-26 07:51:25 PDT

(In reply to youenn fablet from comment #3)
> MediaRecorder is not supported in Mojave, so we just need to rebase the test
> expectation or skip it.
> We skip all media recorder tests for Mojave by default but this might be
> overridden by other expectation lines.
> Karl expectation update seems fine to me.

Thank you Youenn.
Verified test should be skipped for Mojave and leaving test expectation in place.