Bug 242164 - PROGRESSION (251523@main): [ iOS ][ macOS Debug ] imported/w3c/web-platform-tests/service-workers/service-worker/navigation-timing.https.html is a consistent failure
Summary: PROGRESSION (251523@main): [ iOS ][ macOS Debug ] imported/w3c/web-platform-t...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: New Bugs (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-06-29 21:10 PDT by Karl Rackler
Modified: 2022-06-30 14:59 PDT (History)
3 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Karl Rackler 2022-06-29 21:10:53 PDT
Description:
imported/w3c/web-platform-tests/service-workers/service-worker/navigation-timing.https.html

The first failure that I saw on the dashboard was on 6/14/2022 at 251523@main.  This test is a consistent failure on macOS Debug and iOS. 

REPRODUCTION STEPS
I can reproduce this on 251523@main, but unable to reproduce it on 251522@main or earlier.

Command: 
run-webkit-tests --debug --exit-after-n-failures 1 --iterations 50 -f --no-retry imported/w3c/web-platform-tests/service-workers/service-worker/navigation-timing.https.html

Result: 
Regressions: Unexpected text-only failures (1)
  imported/w3c/web-platform-tests/service-workers/service-worker/navigation-timing.https.html [ Failure ]

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fservice-workers%2Fservice-worker%2Fnavigation-timing.https.html&platform=ios&platform=mac&limit=50000

Diff:
--- /Volumes/Data/worker/iOS-15-Simulator-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/navigation-timing.https-expected.txt
+++ /Volumes/Data/worker/iOS-15-Simulator-WK2-Tests-EWS/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/navigation-timing.https-actual.txt
@@ -1,5 +1,5 @@
 
-FAIL Service worker controlled navigation timing assert_greater_than: expected a number greater than 0 but got 0
+PASS Service worker controlled navigation timing
 PASS Service worker controlled navigation timing network fallback
 PASS Service worker controlled navigation timing redirect
Comment 1 Radar WebKit Bug Importer 2022-06-29 21:11:08 PDT
<rdar://problem/96190028>
Comment 2 Karl Rackler 2022-06-29 21:18:12 PDT
I have marked this test as a consistent failure while this issue is investigated.
Comment 3 Karl Rackler 2022-06-29 22:00:43 PDT
Description:
imported/w3c/web-platform-tests/service-workers/service-worker/navigation-timing.https.html is also affected in the same way

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fservice-workers%2Fservice-worker%2Fnavigation-timing.https.html&limit=50000&platform=ios&platform=mac

Diff:
--- /Volumes/Data/worker/Apple-BigSur-Debug-WK2-GPUProcess-Tests/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/navigation-timing.https-expected.txt
+++ /Volumes/Data/worker/Apple-BigSur-Debug-WK2-GPUProcess-Tests/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/navigation-timing.https-actual.txt
@@ -1,5 +1,5 @@
 
-FAIL Service worker controlled navigation timing assert_greater_than: expected a number greater than 0 but got 0
+PASS Service worker controlled navigation timing
 PASS Service worker controlled navigation timing network fallback
 PASS Service worker controlled navigation timing redirect

I have marked this test as a consistent failure while this issue is investigated.
Comment 4 Karl Rackler 2022-06-29 22:12:51 PDT
please disregard
Comment 5 Karl Rackler 2022-06-29 22:13:23 PDT
(In reply to Karl Rackler from comment #3)
> Description:
> imported/w3c/web-platform-tests/service-workers/service-worker/navigation-
> timing.https.html is also affected in the same way
> 
> History:
> https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-
> platform-tests%2Fservice-workers%2Fservice-worker%2Fnavigation-timing.https.
> html&limit=50000&platform=ios&platform=mac
> 
> Diff:
> ---
> /Volumes/Data/worker/Apple-BigSur-Debug-WK2-GPUProcess-Tests/build/layout-
> test-results/imported/w3c/web-platform-tests/service-workers/service-worker/
> navigation-timing.https-expected.txt
> +++
> /Volumes/Data/worker/Apple-BigSur-Debug-WK2-GPUProcess-Tests/build/layout-
> test-results/imported/w3c/web-platform-tests/service-workers/service-worker/
> navigation-timing.https-actual.txt
> @@ -1,5 +1,5 @@
>  
> -FAIL Service worker controlled navigation timing assert_greater_than:
> expected a number greater than 0 but got 0
> +PASS Service worker controlled navigation timing
>  PASS Service worker controlled navigation timing network fallback
>  PASS Service worker controlled navigation timing redirect
> 
> I have marked this test as a consistent failure while this issue is
> investigated.

please disregard duplicate info.
Comment 6 EWS 2022-06-29 23:04:25 PDT
Test gardening commit 251980@main (e542a291dc57): <https://commits.webkit.org/251980@main>

Reviewed commits have been landed. Closing PR #1934 and removing active labels.