Bug 240555

Summary:	REGRESSION(250618@main): [ iOS ] 18X WebPush (API-Tests) are constant failures/timeouts
Product:	WebKit	Reporter:	Robert Jenner <jenner>
Component:	Tools / Tests	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED DUPLICATE
Severity:	Normal	CC:	bfulgham, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=240530

Robert Jenner

Reported 2022-05-17 18:36:33 PDT

The following 18 WebPush API-Tests are constant failures/timeouts on iOS-15 Simulator, and they all appear to have regressed at the same point between 250618@main-250615@main: FAILURES: TestWebKitAPI.ProcessSwap.NavigatingToCaptivePortalMode TestWebKitAPI.PushAPI.firePushEventWithNoPagesFail TestWebKitAPI.PushAPI.firePushEventWithNoPagesSuccessful TestWebKitAPI.PushAPI.firePushEventWithNoPagesTimeout TestWebKitAPI.WebPushDTest.GetPushSubscriptionWithMismatchedPublicToken TestWebKitAPI.WebPushDTest.SubscribeFailureTest TestWebKitAPI.WebPushDTest.SubscribeTest TestWebKitAPI.WebPushDTest.TooManySilentPushesCausesUnsubscribe TestWebKitAPI.WebPushDTest.UnsubscribeTest TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingAllWebsiteData TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingWebsiteDataForOrigin TestWebKitAPI.WebPushDTest.UnsubscribesOnPermissionReset TestWebKitAPI.WebPushDTest.UnsubscribesOnServiceWorkerUnregisterTest TIMEOUTS: TestWebKitAPI.PushAPI.firePushEvent TestWebKitAPI.WebPushD.PermissionManagement TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAES128GCMPush TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAESGCMPush TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedEmptyPush HISTORY: https://results.webkit.org/?suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&suite=api-tests&test=TestWebKitAPI.ProcessSwap.NavigatingToCaptivePortalMode&test=TestWebKitAPI.PushAPI.firePushEvent&test=TestWebKitAPI.PushAPI.firePushEventWithNoPagesFail&test=TestWebKitAPI.PushAPI.firePushEventWithNoPagesSuccessful&test=TestWebKitAPI.PushAPI.firePushEventWithNoPagesTimeout&test=TestWebKitAPI.WebPushD.PermissionManagement&test=TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAES128GCMPush&test=TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedAESGCMPush&test=TestWebKitAPI.WebPushDInjectedPushTest.HandleInjectedEmptyPush&test=TestWebKitAPI.WebPushDTest.GetPushSubscriptionWithMismatchedPublicToken&test=TestWebKitAPI.WebPushDTest.SubscribeFailureTest&test=TestWebKitAPI.WebPushDTest.SubscribeTest&test=TestWebKitAPI.WebPushDTest.TooManySilentPushesCausesUnsubscribe&test=TestWebKitAPI.WebPushDTest.UnsubscribeTest&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingAllWebsiteData&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnClearingWebsiteDataForOrigin&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnPermissionReset&test=TestWebKitAPI.WebPushDTest.UnsubscribesOnServiceWorkerUnregisterTest URL to recent results: https://build.webkit.org/#/builders/270/builds/1757/steps/18/logs/stdio

Attachments
Add attachment proposed patch, testcase, etc.

Radar WebKit Bug Importer

Comment 1 2022-05-17 18:36:52 PDT

<rdar://problem/93468337>

Robert Jenner

Comment 2 2022-05-17 18:40:42 PDT

I was able to reproduce all of these failures and timeouts at iOS-15 Debug ToT using the following test: run-api-tests --ios-simulator --release <API-test-name-goes-here> I was also able to narrow down the regression point. I was able to get it to reproduce as far back as 250618@Main, but it was no longer reproducible at 250615@Main. So it's either 250618@Main, 250617@Main, or 250616@Main that appears to have broken these tests.

Robert Jenner

Comment 3 2022-05-18 10:08:16 PDT

After looking at the three commits that are in the range, I believe https://commits.webkit.org/250618@main is what have caused these tests to break.

Brent Fulgham

Comment 4 2022-05-18 10:31:00 PDT

*** This bug has been marked as a duplicate of bug 240530 ***

Note You need to log in before you can comment on or make changes to this bug.