Bug 209194

Summary: [ macOS wk2 ] imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https.html is flaky failing
Product: WebKit Reporter: Jacob Uphoff <jacob_uphoff>
Component: WebRTCAssignee: Nobody <webkit-unassigned>
Status: RESOLVED CONFIGURATION CHANGED    
Severity: Normal CC: webkit-bot-watchers-bugzilla, webkit-bug-importer, youennf
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Jacob Uphoff 2020-03-17 13:34:25 PDT
imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https.html

This test started to flaky fail pretty recently and the first failure was r258217

I ran the test with 'rwt --root release-258567 imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https.html --force -iterations 2000 -f' and it did not reproduce the failure.

History:

https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCRtpReceiver-getSynchronizationSources.https.html&platform=mac

Diff:

--- /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https-expected.txt
+++ /Volumes/Data/slave/mojave-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCRtpReceiver-getSynchronizationSources.https-actual.txt
@@ -1,14 +1,16 @@
+
+Harness Error (TIMEOUT), message = null
 
 PASS [audio] getSynchronizationSources() eventually returns a non-empty list 
 PASS [audio] RTCRtpSynchronizationSource.timestamp is a number 
 PASS [audio] getSynchronizationSources() does not contain SSRCs older than 10 seconds 
 FAIL [audio] RTCRtpSynchronizationSource.timestamp is comparable to performance.timeOrigin + performance.now() assert_true: expected true got false
 PASS [audio] RTCRtpSynchronizationSource.source is a number 
-PASS [video] getSynchronizationSources() eventually returns a non-empty list 
-PASS [video] RTCRtpSynchronizationSource.timestamp is a number 
-PASS [video] getSynchronizationSources() does not contain SSRCs older than 10 seconds 
-FAIL [video] RTCRtpSynchronizationSource.timestamp is comparable to performance.timeOrigin + performance.now() assert_true: expected true got false
-PASS [video] RTCRtpSynchronizationSource.source is a number 
-PASS [audio-only] RTCRtpSynchronizationSource.audioLevel is a number [0, 1] 
-FAIL [audio-only] RTCRtpSynchronizationSource.voiceActivityFlag is a boolean assert_equals: expected "boolean" but got "undefined"
+TIMEOUT [video] getSynchronizationSources() eventually returns a non-empty list Test timed out
+NOTRUN [video] RTCRtpSynchronizationSource.timestamp is a number 
+NOTRUN [video] getSynchronizationSources() does not contain SSRCs older than 10 seconds 
+NOTRUN [video] RTCRtpSynchronizationSource.timestamp is comparable to performance.timeOrigin + performance.now() 
+NOTRUN [video] RTCRtpSynchronizationSource.source is a number 
+NOTRUN [audio-only] RTCRtpSynchronizationSource.audioLevel is a number [0, 1] 
+NOTRUN [audio-only] RTCRtpSynchronizationSource.voiceActivityFlag is a boolean
Comment 1 Radar WebKit Bug Importer 2020-03-17 13:34:45 PDT
<rdar://problem/60552675>
Comment 2 Jacob Uphoff 2020-03-17 13:38:49 PDT
This failure has been happening on macOS wk2 on debug and release
Comment 3 Jacob Uphoff 2020-03-17 13:47:04 PDT
Set test expectations here: https://trac.webkit.org/changeset/258585/webkit
Comment 4 Ryan Haddad 2020-05-14 12:05:03 PDT
The test is passing now. Removed expectation in r261702.