NEW 277586
[WPT import/export friction] Reference tests require added both an untested -ref.html and an -expected.html
https://bugs.webkit.org/show_bug.cgi?id=277586
Summary [WPT import/export friction] Reference tests require added both an untested -...
Simon Fraser (smfr)
Reported 2024-08-02 20:25:16 PDT
WPT use <link rel="match"> and often share references between tests. WebKit uses one -expected.html per tests. These need to be reconciled (bug 203784) but the current state is annoying and error prone: * You have to add both the -ref.html and -expected.html, as well as the test, so 3 files per test, potentially. * The -ref.html and -expected.html may not match, which means an export followed by an import will cause a behavior change. * There's no local testing that the <link rel="match"> and -ref.html are accurate and produce the expected result.
Attachments
Radar WebKit Bug Importer
Comment 1 2024-08-02 20:25:39 PDT
Simon Fraser (smfr)
Comment 2 2024-09-06 11:34:00 PDT
The mental gyrations required to add new WPT-conformant WPT while also thinking about the WebKit need for -expected.html files are significant. Some things that would help: 1. Let me add tests using the WPT configuration, then run a script to locally create the webkit expectations. 2. Let me run `run-webkit-tests` in a mode that supports `<link rel="match">` 3. Just support `<link rel="match">` (bug 203784).
Simon Fraser (smfr)
Comment 3 2024-09-06 11:34:43 PDT
The thing that makes this non-trivial is that many WPT put the reference file in a different directory, or share a ref between multiple tests.
Note You need to log in before you can comment on or make changes to this bug.