Bug 242014

Summary: [ iOS Release ] TestWebKitAPI.PictureInPicture.ExitPiPOnSuspendVideoElement is a flaky failure
Product: WebKit Reporter: Karl Rackler <rackler>
Component: New BugsAssignee: Nobody <webkit-unassigned>
Status: NEW ---    
Severity: Normal CC: jer.noble, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   

Description Karl Rackler 2022-06-26 09:54:07 PDT
Description:
TestWebKitAPI.PictureInPicture.ExitPiPOnSuspendVideoElement

The first failure that I saw on the dashboard was on 4/7/2022 at 249390@main.  This is affecting iOS Release on iPad Pro (9.7-inch).  This test has been flaky for its entire history on the dashboard.

REPRODUCTION STEPS
I can reproduce this on 251840@main ToT.

Command: 
run-api-tests --root --ipad-simulator --release --no-build TestWebKitAPI.PictureInPicture.ExitPiPOnSuspendVideoElement

Result: 
Test suite failed

Failed

    TestWebKitAPI.PictureInPicture.ExitPiPOnSuspendVideoElement
        VideoFullscreenManager::enterVideoFullscreenForVideoElement(0x69c090ae0)
        VideoFullscreenModelVideoElement 0x69c3e2dc0 ctor
        VideoFullscreenModelVideoElement 0x69c3e2dc0 setVideoElement(0x69e003580)
        VideoFullscreenInterfaceAVKit::setupFullscreen(0x17e070400)
        VideoFullscreenManager::setVideoLayerFrameFenced(0x69c090ae0, 2a)
        VideoFullscreenInterfaceAVKit::enterFullscreen(0x17e070400) 0
        WebFullScreenManager 0x69c5baca0 videoControlsManagerDidChange()
        LEAK: 1 WebProcessPool
        LEAK: 1 WebPageProxy

        /Volumes/Data/worker/OpenSource-ios-simulator-debug-archive/build/OpenSource/Tools/TestWebKitAPI/Tests/WebKitCocoa/ExitPiPOnSuspendVideoElement.mm:84
        Value of: TestWebKitAPI::Util::runFor(&didEnterPiP, 10)
          Actual: false
        Expected: true

History:
https://results.webkit.org/?suite=api-tests&test=TestWebKitAPI.PictureInPicture.ExitPiPOnSuspendVideoElement&limit=50000&platform=ios&model=iPad%20Pro%20(9.7-inch)&style=release

run-api-tests stdio:

Failed
    TestWebKitAPI.PictureInPicture.ExitPiPOnSuspendVideoElement
        
        /Volumes/Data/worker/Apple-iOS-15-Simulator-Release-Build/build/Tools/TestWebKitAPI/Tests/WebKitCocoa/ExitPiPOnSuspendVideoElement.mm:84
        Value of: TestWebKitAPI::Util::runFor(&didEnterPiP, 10)
          Actual: false
        Expected: true
Comment 1 Radar WebKit Bug Importer 2022-06-26 09:54:34 PDT
<rdar://problem/95936294>
Comment 2 Karl Rackler 2022-06-28 23:09:11 PDT
I have disabled this test while this issue is investigated.
Comment 3 EWS 2022-06-29 00:03:12 PDT
Test gardening commit 251945@main (727b2732ae45): <https://commits.webkit.org/251945@main>

Reviewed commits have been landed. Closing PR #1886 and removing active labels.