Description

We are observing differences in test exectuion behavior when executing with the vstest ado task versus just invoking vstest.console.exe manually. What we are seeing is that each batch of test cases is run in it's own test session when running via the ado task whereas all test cases are run in the same test session when running manually with vstest.console.exe.

Steps to reproduce

Run a pipeline (example here) that uses the vstest task and test cases will be run in their own test session. Run the equivalent runsettings/configuration manually with vstest.console.exe and all test cases will be run in the same test session.

Expected behavior

The test case/session behavior should be the same regardless invocation.

Actual behavior

The test case/session behavior is different between the vstest task and the vstest.console.exe

Diagnostic logs

Slice from vstest.console.exe.log
Slice1-from-vstest-ado-task.log
Slice2-from-vstest-ado-task.log

Environment