Bug 207962

Summary:	[ Mac wk2 ] accessibility/mac/aria-menu-item-selected-notification.html is flaky timing out.
Product:	WebKit	Reporter:	Jason Lawrence <Lawrence.j>
Component:	Accessibility	Assignee:	Nobody <webkit-unassigned>
Status:	NEW ---
Severity:	Normal	CC:	webkit-bot-watchers-bugzilla, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Mac
OS:	macOS 10.15

Description Jason Lawrence 2020-02-19 14:16:35 PST

accessibility/mac/aria-menu-item-selected-notification.html

Description:
This test is flaky timing out on Mac wk2. The oldest timeout that I see is r251108, the oldest that I can load with a matching diff is r255863.

History:
https://results.webkit.org/?suite=layout-tests&test=accessibility%2Fmac%2Faria-menu-item-selected-notification.html&flavor=wk2&style=release&limit=50000

Diff:
--- /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/accessibility/mac/aria-menu-item-selected-notification-expected.txt
+++ /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/accessibility/mac/aria-menu-item-selected-notification-actual.txt
@@ -1,25 +1,5 @@
-Menu item 1
-Menu item 2
-Menu item 3
-This tests that a AXMenuItemSelected notification gets fired when a menuitem is focused.
+#PID UNRESPONSIVE - WebKitTestRunner (pid 52130)
+FAIL: Timed out waiting for notifyDone to be called
 
-On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
-
-
-PASS addedNotification is true
-Received menu item selected notification: AXMenuItemSelected
-Menu item selected element: AXRole: AXMenuItem
-Menu item selected element description: AXDescription: item1
-
-Received menu item selected notification: AXMenuItemSelected
-Menu item selected element: AXRole: AXMenuItem
-Menu item selected element description: AXDescription: item2
-
-Received menu item selected notification: AXMenuItemSelected
-Menu item selected element: AXRole: AXMenuItem
-Menu item selected element description: AXDescription: item3
-
-PASS successfullyParsed is true
-
-TEST COMPLETE
-
+#EOF
+#EOF

Comment 1 Radar WebKit Bug Importer 2020-02-19 14:16:50 PST

<rdar://problem/59605517>

Comment 2 Jason Lawrence 2020-02-19 14:20:28 PST

I have marked this test as slow while this issue is being investigated.
https://trac.webkit.org/changeset/256950/webkit

Comment 3 Jason Lawrence 2020-02-19 14:31:59 PST

I am able to reproduce this issue with r256933 by using the command below.
run-webkit-tests accessibility/mac/aria-menu-item-selected-notification.html --iterations 4000 --exit-after-n-failures 5 -f --force

[1068/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
[1068/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
[1085/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
[1210/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
[1269/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
Exiting early after 5 failures. 1266 tests run.


1261 tests ran as expected, 5 didn't (2734 didn't run):