Bug 217908

Summary: imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/moving-between-documents/before-prepare-createHTMLDocument-parse-error-external-module.html is flaky failing
Product: WebKit Reporter: Truitt Savell <tsavell>
Component: DOMAssignee: Nobody <webkit-unassigned>
Status: RESOLVED DUPLICATE    
Severity: Normal CC: ap, cdumez, gsnedders, webkit-bot-watchers-bugzilla, webkit-bug-importer, WebkitBugTracker
Priority: P2 Keywords: InRadar
Version: WebKit Nightly Build   
Hardware: Unspecified   
OS: Unspecified   
See Also: https://bugs.webkit.org/show_bug.cgi?id=217931

Description Truitt Savell 2020-10-19 09:41:23 PDT
imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/moving-between-documents/before-prepare-createHTMLDocument-parse-error-external-module.html

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fscripting-1%2Fthe-script-element%2Fmoving-between-documents%2Fbefore-prepare-createHTMLDocument-parse-error-external-module.html

Diff:
--- /Volumes/Data/slave/ios-simulator-14-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/moving-between-documents/before-prepare-createHTMLDocument-parse-error-external-module-expected.txt
+++ /Volumes/Data/slave/ios-simulator-14-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/moving-between-documents/before-prepare-createHTMLDocument-parse-error-external-module-actual.txt
@@ -1,3 +1,5 @@
+CONSOLE MESSAGE: SyntaxError: Left side of assignment is not a reference.
+CONSOLE MESSAGE: ReferenceError: Can't find variable: scriptOnError
 
 
 PASS Sanity check around top-level Window

So it looks like iOS14 is causing some new console messages.
Comment 1 Truitt Savell 2020-10-19 09:54:08 PDT
It looks like this test is related:

imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/moving-between-documents/before-prepare-createHTMLDocument-success-external-classic.html

History:
https://results.webkit.org/?suite=layout-tests&test=imported%2Fw3c%2Fweb-platform-tests%2Fhtml%2Fsemantics%2Fscripting-1%2Fthe-script-element%2Fmoving-between-documents%2Fbefore-prepare-createHTMLDocument-success-external-classic.html

Diff:
--- /Volumes/Data/slave/ios-simulator-14-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/moving-between-documents/before-prepare-createHTMLDocument-success-external-classic-expected.txt
+++ /Volumes/Data/slave/ios-simulator-14-debug-tests-wk2/build/layout-test-results/imported/w3c/web-platform-tests/html/semantics/scripting-1/the-script-element/moving-between-documents/before-prepare-createHTMLDocument-success-external-classic-actual.txt
@@ -1,3 +1,5 @@
+CONSOLE MESSAGE: exec
+CONSOLE MESSAGE: ReferenceError: Can't find variable: scriptOnLoad
 
 
 PASS Sanity check around top-level Window
Comment 2 Alexey Proskuryakov 2020-10-19 14:53:08 PDT
I see failures on both iOS and macOS, and those have been happening since the test was imported in July.

This part of the test is relative straightforward, basically awaiting a createDocument async function, and putting some properties on the returned value, so this is a little surprising, and not necessarily a test bug.
Comment 3 Radar WebKit Bug Importer 2020-10-26 09:42:18 PDT
<rdar://problem/70682313>
Comment 4 Sam Sneddon [:gsnedders] 2020-12-08 13:44:19 PST

*** This bug has been marked as a duplicate of bug 217931 ***