Running tests tries to run .NET Framework tests with mono on non-Windows

[vcsjones]

When I run tests on my Mac now, it seems to be trying to run .NET Framework tests with mono. For example, running this command on my Mac

./dotnet.sh test src/libraries/System.Security.Cryptography.Pkcs/tests

It will first run all of the .NET (Core) tests and everything passes. Great. Then it proceeds to run the .NET Framework test, and gives this error:

A total of 1 test files matched the specified pattern.
System.IO.FileNotFoundException: Could not find 'mono' host. Make sure that 'mono' is installed on the machine and is available in PATH environment variable.
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Helpers.DotnetHostHelper.GetMonoPath()
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Hosting.DefaultTestHostManager.GetTestHostProcessStartInfo(IEnumerable`1 sources, IDictionary`2 environmentVariables, TestRunnerConnectionInfo connectionInfo)
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Client.ProxyOperationManager.SetupChannel(IEnumerable`1 sources, String runSettings)
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Client.ProxyExecutionManager.StartTestRun(TestRunCriteria testRunCriteria, IInternalTestRunEventsHandler eventHandler)

Even if I install mono, the tests will absolutely crash and burn since most of the project I work on that target .NET Framework assume they are running on Windows. Running S.S.C.Pkcs on macOS with Mono with the .NET Framework target has hundreds of failures.

Was there a change that introduced this recently, and, was it intentional? Or did something change in my environment that's making it try to do this?

I couldn't figure out the best area label to add to this issue. If you have write-permissions please help me learn by adding exactly one area label.

Tagging subscribers to this area: @dotnet/runtime-infrastructure
See info in area-owners.md if you want to be subscribed.

Issue Details

---

When I run tests on my Mac now, it seems to be trying to run .NET Framework tests with mono. For example, running this command on my Mac

./dotnet.sh test src/libraries/System.Security.Cryptography.Pkcs/tests

It will first run all of the .NET (Core) tests and everything passes. Great. Then it proceeds to run the .NET Framework test, and gives this error:

A total of 1 test files matched the specified pattern.
System.IO.FileNotFoundException: Could not find 'mono' host. Make sure that 'mono' is installed on the machine and is available in PATH environment variable.
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Helpers.DotnetHostHelper.GetMonoPath()
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Hosting.DefaultTestHostManager.GetTestHostProcessStartInfo(IEnumerable`1 sources, IDictionary`2 environmentVariables, TestRunnerConnectionInfo connectionInfo)
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Client.ProxyOperationManager.SetupChannel(IEnumerable`1 sources, String runSettings)
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Client.ProxyExecutionManager.StartTestRun(TestRunCriteria testRunCriteria, IInternalTestRunEventsHandler eventHandler)

Even if I install mono, the tests will absolutely crash and burn since most of the project I work on that target .NET Framework assume they are running on Windows. Running S.S.C.Pkcs on macOS with Mono with the .NET Framework target has hundreds of failures.

Was there a change that introduced this recently, and, was it intentional? Or did something change in my environment that's making it try to do this?

Author:	vcsjones
Assignees:	-
Labels:	question, area-Infrastructure, untriaged
Milestone:	-

[ViktorHofer]

Probably regressed with dotnet/arcade@e82404f. I will take a look in the next days.

Tagging subscribers to this area: @dotnet/area-infrastructure-libraries
See info in area-owners.md if you want to be subscribed.

Issue Details

---

When I run tests on my Mac now, it seems to be trying to run .NET Framework tests with mono. For example, running this command on my Mac

./dotnet.sh test src/libraries/System.Security.Cryptography.Pkcs/tests

It will first run all of the .NET (Core) tests and everything passes. Great. Then it proceeds to run the .NET Framework test, and gives this error:

A total of 1 test files matched the specified pattern.
System.IO.FileNotFoundException: Could not find 'mono' host. Make sure that 'mono' is installed on the machine and is available in PATH environment variable.
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Helpers.DotnetHostHelper.GetMonoPath()
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Hosting.DefaultTestHostManager.GetTestHostProcessStartInfo(IEnumerable`1 sources, IDictionary`2 environmentVariables, TestRunnerConnectionInfo connectionInfo)
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Client.ProxyOperationManager.SetupChannel(IEnumerable`1 sources, String runSettings)
   at Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Client.ProxyExecutionManager.StartTestRun(TestRunCriteria testRunCriteria, IInternalTestRunEventsHandler eventHandler)

Even if I install mono, the tests will absolutely crash and burn since most of the project I work on that target .NET Framework assume they are running on Windows. Running S.S.C.Pkcs on macOS with Mono with the .NET Framework target has hundreds of failures.

Was there a change that introduced this recently, and, was it intentional? Or did something change in my environment that's making it try to do this?

Author:	vcsjones
Assignees:	ViktorHofer
Labels:	question, area-Infrastructure-libraries
Milestone:	8.0.0

[Bartleby2718]

@ViktorHofer Do you happen to have any updates on this?

I think my real question is: what's the suggested way to exclude .NET Framework tests? AFAIK exactly one argument is expected for the --framework flag of dotnet test, so I'm not sure if there's a project-agnostic way of excluding .NET Framework tests in a multi-targeting project.

[vcsjones]

I'm not sure if there's a project-agnostic way of excluding .NET Framework tests in a multi-targeting project.

I've been doing something like this for now.

./dotnet.sh test src/libraries/Microsoft.Bcl.Cryptography/tests /p:TargetFramework=net8.0

I can't exclude .NET Framework, but I can run a particular framework, which works for my purposes.