Bug 240555

Summary:	REGRESSION(250618@main): [ iOS ] 18X WebPush (API-Tests) are constant failures/timeouts
Product:	WebKit	Reporter:	Robert Jenner <jenner>
Component:	Tools / Tests	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED DUPLICATE
Severity:	Normal	CC:	bfulgham, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=240530

Description Robert Jenner 2022-05-17 18:36:33 PDT

The following 18 WebPush API-Tests are constant failures/timeouts on iOS-15 Simulator, and they all appear to have regressed at the same point between 250618@main-250615@main:

FAILURES: 
TestWebKitAPI.ProcessSwap.NavigatingToCaptivePortalMode 
TestWebKitAPI.PushAPI.firePushEventWithNoPagesFail
TestWebKitAPI.PushAPI.firePushEventWithNoPagesSuccessful
TestWebKitAPI.PushAPI.firePushEventWithNoPagesTimeout
TestWebKitAPI.WebPushDTest.GetPushSubscriptionWithMismatchedPublicToken
TestWebKitAPI.WebPushDTest.SubscribeFailureTest
TestWebKitAPI.WebPushDTest.SubscribeTest
TestWebKitAPI.WebPushDTest.TooManySilentPushesCausesUnsubscribe
TestWebKitAPI.WebPushDTest.UnsubscribeTest
TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingAllWebsiteData
TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingWebsiteDataForOrigin
TestWebKitAPI.WebPushDTest.UnsubscribesOnPermissionReset
TestWebKitAPI.WebPushDTest.UnsubscribesOnServiceWorkerUnregisterTest

TIMEOUTS:
TestWebKitAPI.PushAPI.firePushEvent
TestWebKitAPI.WebPushD.PermissionManagement
TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAES128GCMPush
TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAESGCMPush
TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedEmptyPush

HISTORY:
https://results.webkit.org/?suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.ProcessSwap.NavigatingToCaptivePortalMode&test=TestWebKitAPI.PushAPI.firePushEvent&test=TestWebKitAPI.PushAPI.firePushEventWithNoPagesFail&test=TestWebKitAPI.PushAPI.firePushEventWithNoPagesSuccessful&test=TestWebKitAPI.PushAPI.firePushEventWithNoPagesTimeout&test=TestWebKitAPI.WebPushD.PermissionManagement&test=TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAES128GCMPush&test=TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAESGCMPush&test=TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedEmptyPush&test=TestWebKitAPI.WebPushDTest.GetPushSubscriptionWithMismatchedPublicToken&test=TestWebKitAPI.WebPushDTest.SubscribeFailureTest&test=TestWebKitAPI.WebPushDTest.SubscribeTest&test=TestWebKitAPI.WebPushDTest.TooManySilentPushesCausesUnsubscribe&test=TestWebKitAPI.WebPushDTest.UnsubscribeTest&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingAllWebsiteData&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingWebsiteDataForOrigin&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnPermissionReset&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnServiceWorkerUnregisterTest

URL to recent results: 
https://build.webkit.org/#/builders/270/builds/1757/steps/18/logs/stdio

Comment 1 Radar WebKit Bug Importer 2022-05-17 18:36:52 PDT

<rdar://problem/93468337>

Comment 2 Robert Jenner 2022-05-17 18:40:42 PDT

I was able to reproduce all of these failures and timeouts at iOS-15 Debug ToT using the following test:

run-api-tests --ios-simulator --release <API-test-name-goes-here>


I was also able to narrow down the regression point. I was able to get it to reproduce as far back as 250618@Main, but it was no longer reproducible at 250615@Main. 


So it's either 250618@Main, 250617@Main, or 250616@Main that appears to have broken these tests.

Comment 3 Robert Jenner 2022-05-18 10:08:16 PDT

After looking at the three commits that are in the range, I believe https://commits.webkit.org/250618@main is what have caused these tests to break.

Comment 4 Brent Fulgham 2022-05-18 10:31:00 PDT


*** This bug has been marked as a duplicate of bug 240530 ***