Bug 209649

Summary:	[WPT] Support running crash tests with run-webkit-tests
Product:	WebKit	Reporter:	Manuel Rego Casasnovas <rego>
Component:	Tools / Tests	Assignee:	Nobody <webkit-unassigned>
Status:	RESOLVED DUPLICATE
Severity:	Normal	CC:	annevk, ap, ashvayka, clopez, fred.wang, gsnedders, webkit-bug-importer
Priority:	P2	Keywords:	InRadar
Version:	WebKit Nightly Build
Hardware:	Unspecified
OS:	Unspecified
See Also:	https://bugs.webkit.org/show_bug.cgi?id=186045
Bug Depends on:
Bug Blocks:	207734

Description Manuel Rego Casasnovas 2020-03-27 05:25:14 PDT

There are a new type of tests in WPT called crash tests: http://web-platform-tests.org/writing-tests/crashtest.html

They don't have any reference and they don't use testharness.js, basically they pass if there's no a crash (sometimes they use "test-wait" similar to reftests with "reftest-wait", see bug #186045).

It'd be nice to have support to run those tests in run-webkit-tests as we're going to end up importing some of them. Right now they are treated as pixel tests somehow, as they dump the render tree (and we know that would be different in every platform, so we'd need to skip these tests for now if they're imported).

Comment 1 Radar WebKit Bug Importer 2020-09-21 15:37:30 PDT

<rdar://problem/69332045>

Comment 2 Sam Sneddon [:gsnedders] 2020-09-24 09:30:23 PDT

*** Bug 216921 has been marked as a duplicate of this bug. ***

Comment 3 Alexey Shvayka 2022-01-25 16:41:01 PST

Ran into this in https://bugs.webkit.org/show_bug.cgi?id=235500 / https://github.com/web-platform-tests/wpt/pull/32544.

Tried linking only <script src="/resources/testharnessreport.js"></script>, didn't work out.

Sadly, imported/w3c/web-platform-tests/domxpath/xpath-evaluate-crash.html is now out-of-sync.

Comment 4 Anne van Kesteren 2023-04-04 08:42:42 PDT

I hit this with two files from WPT FileAPI. I decided not to import them when syncing in https://github.com/WebKit/WebKit/pull/12328. (I actually got confused and thought someone upstream had committed these in error.)

Comment 5 Sam Sneddon [:gsnedders] 2023-04-04 09:10:16 PDT

This was implemented in bug 242633.

*** This bug has been marked as a duplicate of bug 242633 ***