Bug 207978 - [ Mac ] imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html is flaky failing.
Summary: [ Mac ] imported/w3c/web-platform-tests/service-workers/service-worker/resour...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Platform (show other bugs)
Version: WebKit Nightly Build
Hardware: Mac macOS 10.15
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-02-19 17:23 PST by Jason Lawrence
Modified: 2020-02-19 17:28 PST (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Jason Lawrence 2020-02-19 17:23:03 PST
imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html

Description:
This test is flaky failing on Mac throughout the visible history. The oldest diff that I am able to load is r254348, it matches exactly.

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fservice-workers%2Fservice-worker%2Fresource-timing.sub.https.html&limit=50000&platform=mac&style=release&style=debug

Diff:
--- /Volumes/Data/slave/catalina-debug-tests-wk2-gpuprocess/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk2-gpuprocess/build/layout-test-results/imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https-actual.txt
@@ -1,5 +1,5 @@
 
 
-FAIL Controlled resource loads assert_greater_than: Generated response expected a number greater than 0 but got 0
+FAIL Controlled resource loads assert_equals: Generated response expected 1 but got 2
 PASS Non-controlled resource loads
Comment 1 Radar WebKit Bug Importer 2020-02-19 17:23:29 PST
<rdar://problem/59613082>
Comment 2 Jason Lawrence 2020-02-19 17:24:49 PST
I am able to reproduce this issue locally with r256933 using the command below.
run-webkit-tests imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html --iterations 4000 --exit-after-n-failures 5 -f --force -g

[17/4000] imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html failed unexpectedly (text diff)
[118/4000] imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html failed unexpectedly (text diff)
[212/4000] imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html failed unexpectedly (text diff)
[531/4000] imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html failed unexpectedly (text diff)
[612/4000] imported/w3c/web-platform-tests/service-workers/service-worker/resource-timing.sub.https.html failed unexpectedly (text diff)
Exiting early after 5 failures. 609 tests run.


604 tests ran as expected, 5 didn't (3391 didn't run):
Comment 3 Jason Lawrence 2020-02-19 17:28:28 PST
I have marked this test as failing while this issue is investigated.
https://trac.webkit.org/changeset/257012/webkit