Bug 247373

Summary:	REGRESSION: 4 PiP API tests consistently failing on Big Sur EWS
Product:	WebKit	Reporter:	Ryan Haddad <ryanhaddad>
Component:	Tools / Tests	Assignee:	Karl Rackler <rackler>
Status:	RESOLVED FIXED
Severity:	Normal	CC:	hhjalmarsson, jenner, rackler, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	Other
Hardware:	Unspecified
OS:	Unspecified

Description Ryan Haddad 2022-11-02 12:10:07 PDT

The following 4 API test failures are seen on Big Sur EWS bots and negatively impacting turnaround time:
TestWebKitAPI.WKWebViewCloseAllMediaPresentationsInternal.PictureInPicture
TestWebKitAPI.WKWebViewCloseAllMediaPresentations.MultipleSequentialCloseAllMediaPresentations
TestWebKitAPI.WKWebViewCloseAllMediaPresentations.PictureInPicture
TestWebKitAPI.ExitFullscreenOnEnterPiP.ElementFullscreen

Example: https://ews-build.webkit.org/#/builders/3/builds/86895

Comment 1 Radar WebKit Bug Importer 2022-11-02 12:13:18 PDT

<rdar://problem/101873453>

Comment 2 Ryan Haddad 2022-11-02 12:26:57 PDT

Pull request: https://github.com/WebKit/WebKit/pull/6043

Comment 3 EWS 2022-11-02 14:45:08 PDT

Test gardening commit 256245@main (01ba18b12b6e): <https://commits.webkit.org/256245@main>

Reviewed commits have been landed. Closing PR #6043 and removing active labels.

Comment 4 Robert Jenner 2022-11-14 23:04:14 PST

It also looks like at least these three:

TestWebKitAPI.WKWebViewCloseAllMediaPresentationsInternal.PictureInPicture
TestWebKitAPI.WKWebViewCloseAllMediaPresentations.MultipleSequentialCloseAllMediaPresentations
TestWebKitAPI.WKWebViewCloseAllMediaPresentations.PictureInPicture

are consistently timing out on OpenSource Ventura as well:

https://results.webkit.org/?suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.WKWebViewCloseAllMediaPresentations.MultipleSequentialCloseAllMediaPresentations&test=TestWebKitAPI.WKWebViewCloseAllMediaPresentations.PictureInPicture&test=TestWebKitAPI.WKWebViewCloseAllMediaPresentationsInternal.PictureInPicture

I did briefly try to reproduce these timeouts, but was unsuccessful. Still, I think it may be worth disabling these tests for Ventura as well.

Comment 5 Robert Jenner 2022-11-14 23:12:40 PST

Pull request: https://github.com/WebKit/WebKit/pull/6505

Comment 6 Robert Jenner 2022-11-14 23:13:40 PST

(In reply to Robert Jenner from comment #5)
> Pull request: https://github.com/WebKit/WebKit/pull/6505

Testing my disable with Ventura and below with this PR.

Comment 7 EWS 2022-11-16 19:56:16 PST

Test gardening commit 256765@main (7d62c5447127): <https://commits.webkit.org/256765@main>

Reviewed commits have been landed. Closing PR #6505 and removing active labels.

Comment 8 Karl Rackler 2022-12-14 05:55:01 PST

It also looks like at least these three:

TestWebKitAPI.WKWebViewCloseAllMediaPresentationsInternal.PictureInPicture
TestWebKitAPI.WKWebViewCloseAllMediaPresentations.MultipleSequentialCloseAllMediaPresentations
TestWebKitAPI.WKWebViewCloseAllMediaPresentations.PictureInPicture

are consistently timing out on OpenSource Ventura as well:

https://results.webkit.org/?suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.WKWebViewCloseAllMediaPresentations.MultipleSequentialCloseAllMediaPresentations&test=TestWebKitAPI.WKWebViewCloseAllMediaPresentations.PictureInPicture&test=TestWebKitAPI.WKWebViewCloseAllMediaPresentationsInternal.PictureInPicture

Testing my disable with Ventura and below with this PR.

Comment 9 Karl Rackler 2022-12-14 06:16:52 PST

Pull request: https://github.com/WebKit/WebKit/pull/7609

Comment 10 EWS 2022-12-14 07:56:11 PST

Test gardening commit 257855@main (19aa9768e3c6): <https://commits.webkit.org/257855@main>

Reviewed commits have been landed. Closing PR #7609 and removing active labels.

Comment 11 Robert Jenner 2023-01-31 15:51:58 PST

*** Bug 247073 has been marked as a duplicate of this bug. ***