Bug 248694 - Skip WPT tests that time out in at least one sub-test
Summary: Skip WPT tests that time out in at least one sub-test
Status: NEW
Alias: None
Product: WebKit
Classification: Unclassified
Component: Tools / Tests (show other bugs)
Version: WebKit Nightly Build
Hardware: Unspecified Unspecified
: P2 Normal
Assignee: Geoffrey Garen
URL:
Keywords: InRadar
Depends on:
Blocks:
 
Reported: 2022-12-02 16:05 PST by Geoffrey Garen
Modified: 2023-10-17 10:52 PDT (History)
1 user (show)

See Also:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Geoffrey Garen 2022-12-02 16:05:55 PST 
...
Comment 1 Radar WebKit Bug Importer 2022-12-02 16:06:11 PST 
<rdar://problem/102921705>
Comment 2 Sam Sneddon [:gsnedders] 2023-10-17 10:52:38 PDT 
We already often do this; one problem is we don't have a good way to detect that we _shouldn't_ be skipping a test any more (i.e., when we reimport, or when we fix some bug that is causing the timeout currently).

I'm already somewhat concerned by the sheer number of tests in WPT we have marked as SKIP, and not being able to distinguish whether these are because of prior timeouts or for other reasons (such as relying on unsupported features) does seem worrying.