vstest: VS2017 build tools: UWP MsTest, Error: No suitable test runtime provider found for this run.

Description

Not able to run mstest (v2?) in command line for UWP, getting error “No suitable test runtime provider found for this run.”

Steps to reproduce

Created a project by selecting “UnitTest App (Universal Windows)”, selected configuration Release and x86 copied the project to Build machine, Build the project (successfully) using command (after restoring Nuget packages) “C:\Program Files (x86)\Microsoft Visual Studio\2017\BuildTools\MSBuild\15.0\Bin\msbuild.exe” /t:Rebuild /p:Configuration=“Release” /p:Platform=“x86” /verbosity:normal UnitTestProject2.sln"

Run the vstest console command (-Does not work-Error: No suitable test runtime provider found for this run) “C:\Program Files (x86)\Microsoft Visual Studio\2017\BuildTools\Common7\IDE\Extensions\TestPlatform\vstest.console.exe” “D:\Jenkins\workspace\2018 - UnitTest\UnitTestApp1\AppPackages\UnitTestProject2_1.0.0.0_x86_Test\UnitTestProject2_1.0.0.0_x86.appx” /Framework:FrameworkUap10 /TestAdapterPath:“D:\Jenkins\workspace\2018 - UnitTest\UnitTestApp1\bin\x86\Release” /diag:d:\diag1.txt

Run the vstest console command (-Does not work-Error: No suitable test runtime provider found for this run) “C:\Program Files (x86)\Microsoft Visual Studio\2017\BuildTools\Common7\IDE\Extensions\TestPlatform\vstest.console.exe” “D:\Jenkins\workspace\2018 - UnitTest\UnitTestApp1\bin\x86\Release\UnitTestProject2.build.appxrecipe” /Framework:FrameworkUap10 /TestAdapterPath:“D:\Jenkins\workspace\2018 - UnitTest\UnitTestApp1\bin\x86\Release”

Expected behavior

Run unit testcases and possibly get the coverage

Actual behavior

Error: No suitable test runtime provider found for this run

Environment

Project created using VS2017 Pro v15.7.4 Build machine with VS2017 build tools v15.7.4, Agent for VS2017 v15.7.4 .cer file imported to local machine->Trusted root certification authority

Diagnostic logs

TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.684, 512874110761, vstest.console.exe, Using .Net Framework version:Uap,Version=v10.0 TpTrace Verbose: 0 : 9100, 1, 2018/06/20, 17:34:34.699, 512874150632, vstest.console.exe, TestPluginCache: Discovering the extensions using extension path. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.699, 512874163404, vstest.console.exe, AssemblyResolver: Microsoft.TestPlatform.Extensions.BlameDataCollector: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.715, 512874187130, vstest.console.exe, AssemblyResolver: Microsoft.TestPlatform.Extensions.BlameDataCollector: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.715, 512874194714, vstest.console.exe, AssemblyResolver: Microsoft.TestPlatform.Extensions.EventLogCollector: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.715, 512874201358, vstest.console.exe, AssemblyResolver: Microsoft.TestPlatform.Extensions.EventLogCollector: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.715, 512874203630, vstest.console.exe, AssemblyResolver: Microsoft.TestPlatform.TestHostRuntimeProvider: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.715, 512874208720, vstest.console.exe, AssemblyResolver: Microsoft.TestPlatform.TestHostRuntimeProvider: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.715, 512874214648, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestPlatform.Extensions.CodedWebTestAdapter: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.715, 512874219435, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestPlatform.Extensions.CodedWebTestAdapter: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.730, 512874231594, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestPlatform.Extensions.GenericTestAdapter: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.730, 512874236518, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestPlatform.Extensions.GenericTestAdapter: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.730, 512874238295, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestPlatform.Extensions.OrderedTestAdapter: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.730, 512874243289, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestPlatform.Extensions.OrderedTestAdapter: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.730, 512874245033, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestPlatform.Extensions.TmiAdapter: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.730, 512874247512, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestPlatform.Extensions.TmiAdapter: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.777, 512874412487, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestPlatform.Extensions.Trx.TestLogger: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.793, 512874418328, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestPlatform.Extensions.Trx.TestLogger: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.793, 512874425250, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestPlatform.Extensions.VSTestIntegration: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.793, 512874430445, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestPlatform.Extensions.VSTestIntegration: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.793, 512874453124, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestPlatform.Extensions.WebTestAdapter: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.793, 512874457999, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestPlatform.Extensions.WebTestAdapter: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.793, 512874459898, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestTools.CppUnitTestFramework.ComInterfaces: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.793, 512874464699, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestTools.CppUnitTestFramework.ComInterfaces: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.809, 512874466905, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestTools.CppUnitTestFramework.CppUnitTestExtension: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.809, 512874471982, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestTools.CppUnitTestFramework.CppUnitTestExtension: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.809, 512874475400, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestTools.DataCollection.MediaRecorder.Model: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.812, 512874480498, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestTools.DataCollection.MediaRecorder.Model: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.812, 512874481935, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestTools.DataCollection.VideoRecorderCollector: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.812, 512874487113, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TestTools.DataCollection.VideoRecorderCollector: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.812, 512874490977, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TraceDataCollector: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.812, 512874496319, vstest.console.exe, AssemblyResolver: Microsoft.VisualStudio.TraceDataCollector: Resolved assembly. TpTrace Verbose: 0 : 9100, 1, 2018/06/20, 17:34:34.828, 512874532174, vstest.console.exe, TestPluginCache: Discovered the extensions using extension path ‘’. TpTrace Verbose: 0 : 9100, 1, 2018/06/20, 17:34:34.828, 512874534906, vstest.console.exe, TestPluginCache: Discoverers are ‘’. TpTrace Verbose: 0 : 9100, 1, 2018/06/20, 17:34:34.828, 512874535110, vstest.console.exe, TestPluginCache: Executors are ‘’. TpTrace Verbose: 0 : 9100, 1, 2018/06/20, 17:34:34.828, 512874535251, vstest.console.exe, TestPluginCache: Setting providers are ‘’. TpTrace Verbose: 0 : 9100, 1, 2018/06/20, 17:34:34.828, 512874535380, vstest.console.exe, TestPluginCache: Loggers are ‘’. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.828, 512874567051, vstest.console.exe, RunTestsArgumentProcessor:Execute: Test run is starting. TpTrace Verbose: 0 : 9100, 1, 2018/06/20, 17:34:34.828, 512874567289, vstest.console.exe, RunTestsArgumentProcessor:Execute: Queuing Test run. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.828, 512874572573, vstest.console.exe, TestRequestManager.RunTests: run tests started. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.843, 512874585273, vstest.console.exe, Determined framework for all sources: Uap,Version=v10.0 TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.843, 512874591204, vstest.console.exe, Determined platform for all sources: X86 TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.843, 512874600213, vstest.console.exe, Compatible sources list : TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.843, 512874600412, vstest.console.exe, D:\Jenkins\workspace\2018 -UnitTest\UnitTestApp1\bin\x86\Release\UnitTestProject2.build.appxrecipe TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.859, 512874626796, vstest.console.exe, InferRunSettingsHelper.IsTestSettingsEnabled: Unable to navigate to RunSettings/MSTest. Current node: RunSettings TpTrace Verbose: 0 : 9100, 1, 2018/06/20, 17:34:34.859, 512874658286, vstest.console.exe, TestPluginCache: Update extensions started. Skip filter = False TpTrace Verbose: 0 : 9100, 1, 2018/06/20, 17:34:34.859, 512874660305, vstest.console.exe, TestPluginCache: Using directories for assembly resolution ‘D:\Jenkins\workspace\2018 -UnitTest\UnitTestApp1\bin\x86\Release’. TpTrace Verbose: 0 : 9100, 1, 2018/06/20, 17:34:34.859, 512874660510, vstest.console.exe, TestPluginCache: Updated the available extensions to ‘D:\Jenkins\workspace\2018 -UnitTest\UnitTestApp1\bin\x86\Release\Microsoft.VisualStudio.TestPlatform.MSTest.TestAdapter.dll’. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.890, 512874721970, vstest.console.exe, AssemblyResolver: Microsoft.TestPlatform.TestHostRuntimeProvider, Version=15.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a: Resolving assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.890, 512874723770, vstest.console.exe, AssemblyResolver: Microsoft.TestPlatform.TestHostRuntimeProvider, Version=15.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a: Resolved assembly. TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.890, 512874725811, vstest.console.exe, TestPluginManager.CreateTestExtension: Attempting to load test extension: Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Hosting.DefaultTestHostManager TpTrace Information: 0 : 9100, 1, 2018/06/20, 17:34:34.890, 512874728130, vstest.console.exe, TestPluginManager.CreateTestExtension: Attempting to load test extension: Microsoft.VisualStudio.TestPlatform.CrossPlatEngine.Hosting.DotnetTestHostManager TpTrace Error: 0 : 9100, 1, 2018/06/20, 17:34:34.890, 512874730164, vstest.console.exe, TestPlatform.CreateTestRunRequest: No suitable testHostProvider found for runsettings : <RunSettings> <RunConfiguration> <ResultsDirectory>D:\Jenkins\workspace\2018 -UnitTest\UnitTestApp1\TestResults</ResultsDirectory> <TargetPlatform>X86</TargetPlatform> <TargetFrameworkVersion>Uap,Version=v10.0</TargetFrameworkVersion> <TestAdaptersPaths>D:\Jenkins\workspace\2018 -UnitTest\UnitTestApp1\bin\x86\Release</TestAdaptersPaths> <DesignMode>False</DesignMode> <CollectSourceInformation>False</CollectSourceInformation> </RunConfiguration> <LoggerRunSettings> <Loggers> <Logger friendlyName="Console" uri="logger://microsoft/TestPlatform/ConsoleLogger/v1" assemblyQualifiedName="Microsoft.VisualStudio.TestPlatform.CommandLine.Internal.ConsoleLogger, vstest.console, Version=15.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a" codeBase="C:\Program Files (x86)\Microsoft Visual Studio\2017\BuildTools\Common7\IDE\Extensions\TestPlatform\vstest.console.exe" enabled="True" /> </Loggers> </LoggerRunSettings> </RunSettings> TpTrace Error: 0 : 9100, 1, 2018/06/20, 17:34:34.890, 512874736765, vstest.console.exe, TestRequestManager.RunTests: failed to run tests: Microsoft.VisualStudio.TestPlatform.ObjectModel.TestPlatformException: No suitable test runtime provider found for this run. at Microsoft.VisualStudio.TestPlatform.Client.TestPlatform.ThrowExceptionIfTestHostManagerIsNull(ITestRuntimeProvider testHostManager, String settingXml) at Microsoft.VisualStudio.TestPlatform.Client.TestPlatform.CreateTestRunRequest(IRequestData requestData, TestRunCriteria testRunCriteria, TestPlatformOptions options) at Microsoft.VisualStudio.TestPlatform.CommandLine.TestPlatformHelpers.TestRequestManager.RunTests(IRequestData requestData, TestRunCriteria testRunCriteria, ITestRunEventsRegistrar testRunEventsRegistrar, TestPlatformOptions options) TpTrace Error: 0 : 9100, 1, 2018/06/20, 17:34:34.890, 512874737881, vstest.console.exe, ExecuteArgumentProcessor: failed to execute argument process: Microsoft.VisualStudio.TestPlatform.ObjectModel.TestPlatformException: No suitable test runtime provider found for this run. at Microsoft.VisualStudio.TestPlatform.Client.TestPlatform.ThrowExceptionIfTestHostManagerIsNull(ITestRuntimeProvider testHostManager, String settingXml) at Microsoft.VisualStudio.TestPlatform.Client.TestPlatform.CreateTestRunRequest(IRequestData requestData, TestRunCriteria testRunCriteria, TestPlatformOptions options) at Microsoft.VisualStudio.TestPlatform.CommandLine.TestPlatformHelpers.TestRequestManager.RunTests(IRequestData requestData, TestRunCriteria testRunCriteria, ITestRunEventsRegistrar testRunEventsRegistrar, TestPlatformOptions options) at Microsoft.VisualStudio.TestPlatform.CommandLine.TestPlatformHelpers.TestRequestManager.RunTests(TestRunRequestPayload testRunRequestPayload, ITestHostLauncher testHostLauncher, ITestRunEventsRegistrar testRunEventsRegistrar, ProtocolConfig protocolConfig) at Microsoft.VisualStudio.TestPlatform.CommandLine.Processors.RunTestsArgumentExecutor.RunTests(IEnumerable`1 sources) at Microsoft.VisualStudio.TestPlatform.CommandLine.Processors.RunTestsArgumentExecutor.Execute() at Microsoft.VisualStudio.TestPlatform.CommandLine.Executor.ExecuteArgumentProcessor(IArgumentProcessor processor, Int32& exitCode) TpTrace Verbose: 0 : 9100, 1, 2018/06/20, 17:34:34.890, 512874740610, vstest.console.exe, Executor.Execute: Exiting with exit code of 1

About this issue

  • Original URL
  • State: open
  • Created 6 years ago
  • Reactions: 2
  • Comments: 41 (10 by maintainers)

Most upvoted comments

Hi, Yes currently this issue is a blocking one, bz we don’t want to install full VS 2017 in build PC. So we cannot run our unit test projects and also coverage automatically. so we have to end up doing these manually in developer PC. Also I am not sure even with installing VS2017 Pro, I could run the UWP test cases automatically without login to desktop as UWP test cases runs with UI So developers are forced to go with Team server. Regarding coverage, we are not able to get this working with UWP. in VS2017 pro version. I was in impression that UWP is more preferred development than WPF,

Also this point should either a bug or missing feature, but still the status is marked as “Question”?

@MSLukeWest Is it some scenario you have tested?

@Evangelink No, not in Docker or other headless containers. I can’t say for sure whether or not this is possible.