Bug 215949

Summary: [ews] Notify bot watchers about pre-existing and flaky test failures for API tests
Product: WebKit Reporter: Aakash Jain <aakash_jain>
Component: Tools / TestsAssignee: Aakash Jain <aakash_jain>
Status: RESOLVED FIXED    
Severity: Normal CC: aakash_jain, ap, jbedard, ryanhaddad, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: Other   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=215948
https://bugs.webkit.org/show_bug.cgi?id=207475
Attachments:
Description Flags
Patch none

Description Aakash Jain 2020-08-28 13:34:35 PDT
Notify bot watchers about pre-existing and flaky test failures for API tests found in EWS.
Comment 1 Aakash Jain 2020-09-04 04:36:45 PDT
Created attachment 407957 [details]
Patch
Comment 2 Jonathan Bedard 2020-09-04 11:18:04 PDT
Comment on attachment 407957 [details]
Patch

View in context: https://bugs.webkit.org/attachment.cgi?id=407957&action=review

> Tools/BuildSlaveSupport/ews-build/steps.py:2606
> +    def send_email_for_flaky_failure(self, test_name):

I'm find with this as-is, but it does seem like we're duplicating quite a bit of code for layout test emails.

Seems like we might want a base "AnalyzeTestResults" step with a "send_email_for_flaky_failure(self, test_name):" function that pulls from a "suite" variable
Comment 3 Aakash Jain 2020-09-04 11:43:35 PDT
Yeah, will do that in a separate patch.
Comment 4 EWS 2020-09-04 11:51:03 PDT
Committed r266626: <https://trac.webkit.org/changeset/266626>

All reviewed patches have been landed. Closing bug and clearing flags on attachment 407957 [details].
Comment 5 Radar WebKit Bug Importer 2020-09-04 11:52:19 PDT
<rdar://problem/68358168>