vstest: Tests suddenly failing to run in Azure DevOps pipeline - No suitable test runtime provider was found for any source in this run

Description

I have been using the Test Assemblies task in several different pipelines related to a single project. This has been working without issue for years.

Today, I’ve encountered an issue where this task fails with an error “No suitable test runtime provider was found for any source in this run”.

At first I was able to get the build to succeed just by re-running it, but after a few hours since the first occurrence I’m finding that the failure occurs no matter how many times I run the build.

I have not recently changed anything about my project that would affect this. And the fact that the build step succeeded intermittently after the issue started occurring, and then stopped working altogether, suggests that this is likely the result of some new change being rolled out in Azure DevOps.

Do you know of any such change being rolled out, and if so, what is the best way to deal with this situation?

Steps to reproduce

I do not have steps that would be reproducible in general. I simply initiate the pipeline and it fails 50-80% of the time.

Expected behavior

The Test Assemblies task runs the tests.

Actual behavior

Error:

##[error]No suitable test runtime provider was found for any source in this run.

Diagnostic logs

Attached: VSTest Log.txt

Environment

Azure DevOps

Agent: windows-latest Test Assemblies task - Test platform version: Latest

About this issue

  • Original URL
  • State: closed
  • Created a year ago
  • Comments: 18 (8 by maintainers)

Most upvoted comments

The failure is on 17.6.0 vstest console, you can update it by using the TestPlatform installer task, and install Latest, which will choose 17.6.1.

And then on your VSTest task you choose: Version installed by installer.

https://learn.microsoft.com/en-us/azure/devops/pipelines/tasks/reference/visual-studio-test-platform-installer-v1?view=azure-pipelines