Bug 212776

Summary:	REGRESSION: [ Mac wk2 ] inspector/heap/getRemoteObject.html is flaky failing.
Product:	WebKit	Reporter:	Jason Lawrence <Lawrence.j>
Component:	Web Inspector	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	inspector-bugzilla-changes, webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Mac
OS:	macOS 10.15
See Also:	https://bugs.webkit.org/show_bug.cgi?id=206936 https://bugs.webkit.org/show_bug.cgi?id=206903

Description Jason Lawrence 2020-06-04 13:25:21 PDT

inspector/heap/getRemoteObject.html

Description:
This test is flaky failing on Mac wk2. The flaky failures first appeared in the visible history on 05/08/2020, it began failing more frequently on 05/18/2020.

History:
https://results.webkit.org/?suite=layout-tests&test=inspector%2Fheap%2FgetRemoteObject.html&limit=50000

Diff:
--- /Volumes/Data/slave/catalina-debug-tests-wk2/build/layout-test-results/inspector/heap/getRemoteObject-expected.txt
+++ /Volumes/Data/slave/catalina-debug-tests-wk2/build/layout-test-results/inspector/heap/getRemoteObject-actual.txt
@@ -18,6 +18,8 @@
 -- Running test case: GetRemoteObjectCollectedObject
 PASS: Should not have an error creating a snapshot.
 PASS: Should should include at least one 'Map' instance.
-PASS: Should get an error when object has been collected.
-PASS: No object for identifier, it may have been collected
+FAIL: Should get an error when object has been collected.
+    Expected: truthy
+    Actual: null
+PASS: null

Comment 1 Radar WebKit Bug Importer 2020-06-04 13:25:51 PDT

<rdar://problem/63992744>

Comment 2 Jason Lawrence 2020-06-04 14:05:25 PDT

I can reproduce this issue with r262540 and r261845, but I cannot reproduce it with r261844.

Command:
run-webkit-tests --iterations 199 --exit-after-n-failures 30 --force -f inspector/heap/getRemoteObject.html

r261845:
[18/99] inspector/heap/getRemoteObject.html failed unexpectedly (text diff)
[54/99] inspector/heap/getRemoteObject.html failed unexpectedly (text diff)
[65/99] inspector/heap/getRemoteObject.html failed unexpectedly (text diff)
Exiting early after 3 failures. 62 tests run.

r261844:
[113/199] inspector/heap/getRemoteObject.html failed unexpectedly (com.apple.WebKit.WebContent.Development crashed [pid=55776])
[199/199] inspector/heap/getRemoteObject.html failed unexpectedly (com.apple.WebKit.WebContent.Development crashed [pid=55778])
197 tests ran as expected, 2 didn't:

Comment 3 Jason Lawrence 2020-06-05 07:28:53 PDT

I have marked this test as flaky failing while this issue is investigated.
https://trac.webkit.org/changeset/262617/webkit