Bug 249051

Summary:	[ews] re-run-layout-tests ignores the failures when first layout test run failed with infra issue
Product:	WebKit	Reporter:	Aakash Jain <aakash_jain>
Component:	Tools / Tests	Assignee:	Aakash Jain <aakash_jain>
Status:	RESOLVED FIXED
Severity:	Normal	CC:	aakash_jain, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	Other
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=249049 https://bugs.webkit.org/show_bug.cgi?id=248553

Description Aakash Jain 2022-12-09 15:54:54 PST

[ews] re-run-layout-tests ignores the failures when first layout test run failed with infra issue. 

eg.: https://ews-build.webkit.org/#/builders/10/builds/168571, https://ews-build.webkit.org/#/builders/10/builds/168925, https://ews-build.webkit.org/#/builders/10/builds/169015
In these runs first layout-tests failed and didn't even run layout-tests, re-run-layout-tests noticed some failures and compared with first run and thought them to be flaky and so ignored them.

 
re-run-layout-tests shouldn't ignore the failures (as flaky) when first layout test run failed with infra issue.

Comment 1 Radar WebKit Bug Importer 2022-12-16 15:55:16 PST

<rdar://problem/103464148>

Comment 2 Aakash Jain 2023-01-09 09:00:55 PST

This was fixed by https://github.com/WebKit/WebKit/pull/7417