Bug 216159

Summary:	REGRESSION(r266511): [ macOS iOS wk2 ] imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https.html is a flaky failure
Product:	WebKit	Reporter:	Hector Lopez <hector_i_lopez>
Component:	WebRTC	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	webkit-bot-watchers-bugzilla, webkit-bug-importer, youennf
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified

Description Hector Lopez 2020-09-03 17:34:41 PDT

imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https.html

Test is a flaky failure according to history on macOS wk2 and iOS wk2 Debug. First occurrence of failure is at r266511.

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fwebrtc%2FRTCPeerConnection-restartIce.https.html

Diff:
--- /Volumes/Data/slave/ipados-simulator-13-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-expected.txt
+++ /Volumes/Data/slave/ipados-simulator-13-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-actual.txt
@@ -1,5 +1,5 @@
 
-FAIL restartIce() does not trigger negotiation ahead of initial negotiation assert_equals: No negotiationneeded event expected (undefined) undefined but got (object) object "[object Event]"
+PASS restartIce() does not trigger negotiation ahead of initial negotiation 
 PASS restartIce() has no effect on initial negotiation 
 PASS restartIce() fires negotiationneeded after initial negotiation 
 PASS restartIce() causes fresh ufrags

Comment 1 Radar WebKit Bug Importer 2020-09-03 17:35:03 PDT

<rdar://problem/68312152>

Comment 2 Hector Lopez 2020-09-03 17:44:07 PDT

Test expectation while investigated:

https://trac.webkit.org

Comment 3 Ryan Haddad 2021-04-19 17:04:29 PDT

This test is now a consistent failure, so I don't know if it is still flaky:
--- /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-expected.txt
+++ /Volumes/Data/worker/bigsur-release-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/webrtc/RTCPeerConnection-restartIce.https-actual.txt
@@ -10,6 +10,6 @@
 PASS restartIce() survives remote offer
 PASS restartIce() is satisfied by remote ICE restart
 PASS restartIce() trumps {iceRestart: false}
-FAIL restartIce() survives rollback promise_test: Unhandled rejection with value: object "InvalidStateError: Description type incompatible with current signaling state"
+FAIL restartIce() survives rollback promise_test: Unhandled rejection with value: object "InvalidStateError: Local description type 3 is incompatible with current signaling state 1"
 FAIL restartIce() survives remote offer containing partial restart assert_false: Restarted 2 expected false got true

Comment 4 Ryan Haddad 2021-05-03 13:35:33 PDT

(In reply to Ryan Haddad from comment #3)
> This test is now a consistent failure, so I don't know if it is still flaky:
Rebaselined in https://trac.webkit.org/changeset/276922/webkit, will need to check on results in a day or two to see if the test is still flaky.

Comment 5 Ryan Haddad 2021-05-11 09:52:51 PDT

(In reply to Ryan Haddad from comment #4)
> (In reply to Ryan Haddad from comment #3)
> > This test is now a consistent failure, so I don't know if it is still flaky:
> Rebaselined in https://trac.webkit.org/changeset/276922/webkit, will need to
> check on results in a day or two to see if the test is still flaky.
Definitely still flaky.