Bug 206699

Summary: [ macOS ] http/tests/media/now-playing-info.html is flaky failing
Product: WebKit Reporter: Jacob Uphoff <jacob_uphoff>
Component: Tools / TestsAssignee: Nobody <webkit-unassigned>
Status: RESOLVED CONFIGURATION CHANGED    
Severity: Normal CC: webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
Attachments:
Description Flags
Update Test Expectations none

Description Jacob Uphoff 2020-01-23 13:55:57 PST
http/tests/media/now-playing-info.html is flaky failing, the first failure is tied to commit 253626 however I do not believe that is where the failure started and with the gap between the failures, I am not certain where this started.

I did not try to reproduce the failure, it is happening on macOS wk2

history:
https://results.webkit.org/?suite=layout-tests&test=http%2Ftests%2Fmedia%2Fnow-playing-info.html

diff:
--- /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/http/tests/media/now-playing-info-expected.txt
+++ /Volumes/Data/slave/catalina-release-tests-wk2/build/layout-test-results/http/tests/media/now-playing-info-actual.txt
@@ -20,25 +20,6 @@
 
 * Set video title, it should be used.
 RUN(video.title = "Video Title")
-RUN(nowPlayingState = internals.nowPlayingState)
-EXPECTED (nowPlayingState.registeredAsNowPlayingApplication == 'true') OK
-EXPECTED (nowPlayingState.title == 'Video Title') OK
-EXPECTED (nowPlayingState.duration > '0') OK
-
-* Clear video and page titles, page domain should be used.
-RUN(video.title = "")
-RUN(document.title = "")
-RUN(nowPlayingState = internals.nowPlayingState)
-EXPECTED (nowPlayingState.registeredAsNowPlayingApplication == 'true') OK
-EXPECTED (nowPlayingState.title == '127.0.0.1') OK
-EXPECTED (nowPlayingState.duration > '0') OK
-
-* Change currentTime, state should be updated.
-RUN(video.currentTime = video.currentTime + 0.5)
-RUN(nowPlayingState = internals.nowPlayingState)
-EXPECTED (nowPlayingState.registeredAsNowPlayingApplication == 'true') OK
-EXPECTED (nowPlayingState.title == '127.0.0.1') OK
-EXPECTED (nowPlayingState.duration > '0') OK
-
+** Timed out waiting for "title" to change from "Page Title" FAIL
 END OF TEST
Comment 1 Radar WebKit Bug Importer 2020-01-23 13:56:21 PST
<rdar://problem/58847192>
Comment 2 Jacob Uphoff 2020-01-27 16:40:12 PST
Created attachment 388937 [details]
Update Test Expectations
Comment 3 Jacob Uphoff 2020-02-14 10:54:56 PST
Set expectations here: https://trac.webkit.org/changeset/256626/webkit
Comment 4 Ryan Haddad 2020-05-27 11:04:58 PDT
Removed flaky expectation in r262202 since the test is consistently passing.