Bug 217181

Summary: Limit number of tests to log in case of large number of API test failures
Product: WebKit Reporter: Aakash Jain <aakash_jain>
Component: Tools / TestsAssignee: Aakash Jain <aakash_jain>
Status: RESOLVED FIXED    
Severity: Normal CC: aakash_jain, jbedard, ryanhaddad, webkit-bug-importer
Priority: P2 Keywords: InRadar
Version: Other   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=217085
Attachments:
Description Flags
Patch none

Description Aakash Jain 2020-10-01 08:41:39 PDT 
Limit number of tests to log in analyze-api-tests-results step in case of large number of API test failures. This logging is secondary, and is just to help in debugging. In case of thousands of failures, it becomes unreadable. e.g.: https://ews-build.webkit.org/#/builders/9/builds/461/steps/12/logs/stderr

We should limit the number of failures to log in analyze-jsc-tests-results step so as to keep it readable, (and also to avoid store all these huge logs unnecessarily in Buildbot database).

Similar to Bug 217085.
Comment 1 Aakash Jain 2020-10-01 08:44:01 PDT 
Created attachment 410235 [details]
Patch
Comment 2 EWS 2020-10-01 13:58:40 PDT 
Found 1 new test failure: inspector/console/queryHolders.html
Comment 3 EWS 2020-10-01 17:18:55 PDT 
Committed r267862: <https://trac.webkit.org/changeset/267862>

All reviewed patches have been landed. Closing bug and clearing flags on attachment 410235 [details].
Comment 4 Radar WebKit Bug Importer 2020-10-01 17:19:17 PDT 
<rdar://problem/69863202>