Wasm Browser work items failing with OpenQA.Selenium.WebDriverException

[ViktorHofer]

[00:03:37] crit: OpenQA.Selenium.WebDriverException: Cannot start the driver service on http://localhost:37245/
                    at OpenQA.Selenium.DriverService.Start()
                    at OpenQA.Selenium.Remote.DriverServiceCommandExecutor.Execute(Command commandToExecute)
                    at OpenQA.Selenium.Remote.RemoteWebDriver.Execute(String driverCommandToExecute, Dictionary`2 parameters)
                    at OpenQA.Selenium.Remote.RemoteWebDriver.StartSession(ICapabilities desiredCapabilities)
                    at OpenQA.Selenium.Remote.RemoteWebDriver..ctor(ICommandExecutor commandExecutor, ICapabilities desiredCapabilities)
                    at OpenQA.Selenium.Chromium.ChromiumDriver..ctor(ChromiumDriverService service, ChromiumOptions options, TimeSpan commandTimeout)
                    at OpenQA.Selenium.Chrome.ChromeDriver..ctor(ChromeDriverService service, ChromeOptions options, TimeSpan commandTimeout)
                    at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestBrowserCommand.GetChromeDriver(ILogger logger) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/Browser/WasmTestBrowserCommand.cs:line 110
                    at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestBrowserCommand.InvokeInternal(ILogger logger) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/Browser/WasmTestBrowserCommand.cs:line 53
                    at Microsoft.DotNet.XHarness.Common.CLI.Commands.XHarnessCommand.Invoke(IEnumerable`1 arguments) in /_/src/Microsoft.DotNet.XHarness.Common/CLI/Commands/XHarnessCommand.cs:line 120
XHarness exit code: 71

Console log: https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-44835-merge-bb0f134359584f1080/System.Text.Encoding.CodePages.Tests/console.1329b837.log?sv=2019-07-07&se=2020-12-07T23%3A45%3A59Z&sr=c&sp=rl&sig=un3ihnU48W%2BrW%2FnAWOvHl%2Fd9djtH7rUx13LlD1Kipe0%3D

Build: https://dev.azure.com/dnceng/public/_build/results?buildId=889822&view=ms.vss-test-web.build-test-results-tab&runId=28458820&resultId=144669&paneView=attachments

cc @steveisok @akoeplinger

[Dotnet-GitSync-Bot]

I couldn't figure out the best area label to add to this issue. If you have write-permissions please help me learn by adding exactly one area label.

Tagging subscribers to this area: @directhex
See info in area-owners.md if you want to be subscribed.

Issue Details

Description:	[00:03:37] crit: OpenQA.Selenium.WebDriverException: Cannot start the driver service on http://localhost:37245/ at OpenQA.Selenium.DriverService.Start() at OpenQA.Selenium.Remote.DriverServiceCommandExecutor.Execute(Command commandToExecute) at OpenQA.Selenium.Remote.RemoteWebDriver.Execute(String driverCommandToExecute, Dictionary`2 parameters) at OpenQA.Selenium.Remote.RemoteWebDriver.StartSession(ICapabilities desiredCapabilities) at OpenQA.Selenium.Remote.RemoteWebDriver..ctor(ICommandExecutor commandExecutor, ICapabilities desiredCapabilities) at OpenQA.Selenium.Chromium.ChromiumDriver..ctor(ChromiumDriverService service, ChromiumOptions options, TimeSpan commandTimeout) at OpenQA.Selenium.Chrome.ChromeDriver..ctor(ChromeDriverService service, ChromeOptions options, TimeSpan commandTimeout) at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestBrowserCommand.GetChromeDriver(ILogger logger) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/Browser/WasmTestBrowserCommand.cs:line 110 at Microsoft.DotNet.XHarness.CLI.Commands.Wasm.WasmTestBrowserCommand.InvokeInternal(ILogger logger) in /_/src/Microsoft.DotNet.XHarness.CLI/Commands/WASM/Browser/WasmTestBrowserCommand.cs:line 53 at Microsoft.DotNet.XHarness.Common.CLI.Commands.XHarnessCommand.Invoke(IEnumerable`1 arguments) in /_/src/Microsoft.DotNet.XHarness.Common/CLI/Commands/XHarnessCommand.cs:line 120 XHarness exit code: 71 Console log: https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-44835-merge-bb0f134359584f1080/System.Text.Encoding.CodePages.Tests/console.1329b837.log?sv=2019-07-07&se=2020-12-07T23%3A45%3A59Z&sr=c&sp=rl&sig=un3ihnU48W%2BrW%2FnAWOvHl%2Fd9djtH7rUx13LlD1Kipe0%3D Build: https://dev.azure.com/dnceng/public/_build/results?buildId=889822&view=ms.vss-test-web.build-test-results-tab&runId=28458820&resultId=144669&paneView=attachments cc @steveisok @akoeplinger
Author:	ViktorHofer
Assignees:	-
Labels:	area-Infrastructure-mono, os-android, untriaged
Milestone:	-

[steveisok]

@radical Not sure what to make of this

[steveisok]

Another build with the same failure:

https://dev.azure.com/dnceng/public/_build/results?buildId=890219&view=ms.vss-test-web.build-test-results-tab&runId=28469708&resultId=100001&paneView=dotnet-dnceng.dnceng-build-release-tasks.helix-test-information-tab

[radical]

Another build with the same failure:

https://dev.azure.com/dnceng/public/_build/results?buildId=890219&view=ms.vss-test-web.build-test-results-tab&runId=28469708&resultId=100001&paneView=dotnet-dnceng.dnceng-build-release-tasks.helix-test-information-tab

Lots of failed tests there. They seem to be failing with mono assertions, eg:

[03:44:57] info: MONO_WASM: ICU data archive(s) loaded, disabling invariant mode
[03:44:57] info: * Assertion at /__w/1/s/src/mono/mono/metadata/assembly.c:4698, condition `<disabled>' not met
[03:44:57] info: * Assertion at /__w/1/s/src/mono/mono/metadata/assembly.c:4698, condition `<disabled>' not met
[03:44:57] info: Unhandled exception in _finalize_startup
[03:44:57] fail: [out of order message from the browser]: http://127.0.0.1:35439/index.html?arg=--run&arg=WasmTestRunner.dll&arg=System.Xml.Xsl.XslTransformApi.Tests.dll&arg=-notrait&arg=category%3dIgnoreForCI&arg=-notrait&arg=category%3dOuterLoop&arg=-notrait&arg=category%3dfailing 0:0 Uncaught ExitStatus: Program terminated with exit(0)

System.Xml.Xsl.XslTransform.Api.Tests

I didn't look at all of them, fyi.

[radical]

@radical Not sure what to make of this

This might be because of a race. I'll investigate.