vstest: Tests suddenly failing to run in Azure DevOps pipeline - No suitable test runtime provider was found for any source in this run
Description
I have been using the Test Assemblies task in several different pipelines related to a single project. This has been working without issue for years.
Today, I’ve encountered an issue where this task fails with an error “No suitable test runtime provider was found for any source in this run”.
At first I was able to get the build to succeed just by re-running it, but after a few hours since the first occurrence I’m finding that the failure occurs no matter how many times I run the build.
I have not recently changed anything about my project that would affect this. And the fact that the build step succeeded intermittently after the issue started occurring, and then stopped working altogether, suggests that this is likely the result of some new change being rolled out in Azure DevOps.
Do you know of any such change being rolled out, and if so, what is the best way to deal with this situation?
Steps to reproduce
I do not have steps that would be reproducible in general. I simply initiate the pipeline and it fails 50-80% of the time.
Expected behavior
The Test Assemblies task runs the tests.
Actual behavior
Error:
##[error]No suitable test runtime provider was found for any source in this run.
Diagnostic logs
Attached: VSTest Log.txt
Environment
Azure DevOps
Agent: windows-latest Test Assemblies task - Test platform version: Latest
About this issue
- Original URL
- State: closed
- Created a year ago
- Comments: 18 (8 by maintainers)
The failure is on 17.6.0 vstest console, you can update it by using the TestPlatform installer task, and install Latest, which will choose 17.6.1.
And then on your VSTest task you choose: Version installed by installer.
https://learn.microsoft.com/en-us/azure/devops/pipelines/tasks/reference/visual-studio-test-platform-installer-v1?view=azure-pipelines