Bug 207962 - [ Mac wk2 ] accessibility/mac/aria-menu-item-selected-notification.html is flaky timing out.
Summary: [ Mac wk2 ] accessibility/mac/aria-menu-item-selected-notification.html is fl...
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Accessibility (show other bugs)
Version: WebKit Nightly Build
Hardware: Mac macOS 10.15
: P2 Normal
Assignee: Nobody
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2020-02-19 14:16 PST by Jason Lawrence
Modified: 2020-02-19 14:31 PST (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Jason Lawrence 2020-02-19 14:16:35 PST
accessibility/mac/aria-menu-item-selected-notification.html

Description:
This test is flaky timing out on Mac wk2. The oldest timeout that I see is r251108, the oldest that I can load with a matching diff is r255863.

History:
https://results.webkit.org/?suite=layout-tests&test=accessibility%2Fmac%2Faria-menu-item-selected-notification.html&flavor=wk2&style=release&limit=50000

Diff:
--- /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/accessibility/mac/aria-menu-item-selected-notification-expected.txt
+++ /Volumes/Data/slave/mojave-release-tests-wk2/build/layout-test-results/accessibility/mac/aria-menu-item-selected-notification-actual.txt
@@ -1,25 +1,5 @@
-Menu item 1
-Menu item 2
-Menu item 3
-This tests that a AXMenuItemSelected notification gets fired when a menuitem is focused.
+#PID UNRESPONSIVE - WebKitTestRunner (pid 52130)
+FAIL: Timed out waiting for notifyDone to be called
 
-On success, you will see a series of "PASS" messages, followed by "TEST COMPLETE".
-
-
-PASS addedNotification is true
-Received menu item selected notification: AXMenuItemSelected
-Menu item selected element: AXRole: AXMenuItem
-Menu item selected element description: AXDescription: item1
-
-Received menu item selected notification: AXMenuItemSelected
-Menu item selected element: AXRole: AXMenuItem
-Menu item selected element description: AXDescription: item2
-
-Received menu item selected notification: AXMenuItemSelected
-Menu item selected element: AXRole: AXMenuItem
-Menu item selected element description: AXDescription: item3
-
-PASS successfullyParsed is true
-
-TEST COMPLETE
-
+#EOF
+#EOF
Comment 1 Radar WebKit Bug Importer 2020-02-19 14:16:50 PST
<rdar://problem/59605517>
Comment 2 Jason Lawrence 2020-02-19 14:20:28 PST
I have marked this test as slow while this issue is being investigated.
https://trac.webkit.org/changeset/256950/webkit
Comment 3 Jason Lawrence 2020-02-19 14:31:59 PST
I am able to reproduce this issue with r256933 by using the command below.
run-webkit-tests accessibility/mac/aria-menu-item-selected-notification.html --iterations 4000 --exit-after-n-failures 5 -f --force

[1068/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
[1068/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
[1085/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
[1210/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
[1269/4000] accessibility/mac/aria-menu-item-selected-notification.html failed unexpectedly (test timed out, text diff)
Exiting early after 5 failures. 1266 tests run.


1261 tests ran as expected, 5 didn't (2734 didn't run):