azure-pipelines-tasks: vstest rerun fails with nunit testcase

Required Information

Question, Bug, or Feature?
Type: Bug

Enter Task Name: VSTest@2

Environment

  • Server - tfs on-premises

    • If using TFS on-premises, provide the version:
About Azure DevOps Server
Version Azure DevOps Server 2020 Update 1
  • Agent - Hosted or Private:
    • private, win 10, Current agent version: ‘2.181.2’

Issue Description

  • NUnit adapter 3.11.2.0
  • Microsoft Test Execution Command Line Tool Version 17.2.0-preview-20220401-08

VSTest@2 with nunit3 adapter fails to execute the test re-run due to character escaping:

Error logs

First run:

vstest.console.exe "tests1.dll" "tests2.dll"
/TestCaseFilter:"Category=X&Category=Y&Category!=Z&Category!=W"
/Settings:"E:\ANSYSDev\TFSAgent\_work\_temp\ctrrwcwxein.tmp.runsettings" 
/Logger:"trx" 
/TestAdapterPath:"E:\ANSYSDev\TFSAgent\_work\_temp\Tests" 

retry:

vstest.console.exe /TestCaseFilter:"FullyQualifiedName=Ansys.Artemis.Aim.Integration.Daily.Tests.Internal.FluidConvergenceControlsShould.SolveMultiBodyVolumeMonitor(4\,2.7068d\,1.4408d)|FullyQualifiedName=..."
"E:\ANSYSDev\TFSAgent\_work\_temp\Tests\AIM.Services.Artemis.Testing.22.2.0-unstable1462\lib\net47\Ansys.Artemis.Aim.Integration.Daily.Tests.dll"
/Settings:"E:\ANSYSDev\TFSAgent\_work\_temp\ctrrwcwxein.tmp.runsettings"
/Logger:"trx"
/TestAdapterPath:"E:\ANSYSDev\TFSAgent\_work\_temp\Tests"

##[error]An exception occurred while invoking executor 'executor://nunit3testexecutor/': Filter string '4\,2.7068d\,1.4408d' includes unrecognized escape sequence.

The test:

        [Test]
        [Category(TestCategories.BoundaryMonitor)]
        [Timeout(StandardTimeoutValues.ms.TenMinutes)]
        [TestCase(1, 2.944379, 1.4609, Description = "scenario 1 - ...")]
        [TestCase(2, 2.944379, 1.4609, Description = "scenario 2 - ...")]
        [TestCase(3, 2.7068, 1.4408, Description = "scenario 3 - ...")]
        [TestCase(4, 2.7068, 1.4408, Description = "scenario 4 - ...")]
        public void SolveMultiBodyVolumeMonitor(int scenario, double max, double ave)
        {...}

About this issue

  • Original URL
  • State: open
  • Created 2 years ago
  • Reactions: 2
  • Comments: 15

Most upvoted comments

No reason to close afaik