sdk: Unable to test non-Core code on Linux
(Apologies if this is the wrong repo for this; it’s not clear to me whether this is xUnit-specific or the expected behaviour when testing on Linux.)
Background
I have projects which don’t target core yet, but I still want to test on Travis. They work fine on RC1 (with dnx test and the old xUnit setup) and work fine with an updated project.json on Windows, but fail to run tests on Linux.
It’s not clear whether the non-core runtimes/frameworks are expected to work on non-Windows platforms. Using dotnet run works fine for a console app with a TFM of net451, so it’s clearly got some knowledge… but dotnet test fails.
Similar issues: dotnet/sdk#4833, dotnet/sdk#5172.
Steps to reproduce
Create xUnit test project with a framework of net451, and run dotnet restore, dotnet build, dotnet test.
Sample project.json:
{
"dependencies": {
"xunit": "2.1.0",
"dotnet-test-xunit": "1.0.0-rc2-build10015",
},
"testRunner": "xunit",
"frameworks": {
"net451": { }
}
}
Sample C#:
using Xunit;
public class Test
{
[Fact] public void Foo() {}
}
Expected behavior
Tests run (using Mono).
Actual behavior
Restore and build both work, but test fails:
dotnet-test Error: 0 : Microsoft.DotNet.Cli.Utils.CommandUnknownException: No executable found matching command "dotnet-test-xunit"
at Microsoft.DotNet.Cli.Utils.ProjectDependenciesCommandFactory.FindProjectDependencyCommands(String commandName, IEnumerable`1 commandArgs, String configuration, NuGetFramework framework, String outputPath, String buildBasePath, String projectDirectory)
at Microsoft.DotNet.Cli.Utils.ProjectDependenciesCommandFactory.Create(String commandName, IEnumerable`1 args, NuGetFramework framework, String configuration)
at Microsoft.DotNet.Tools.Test.ConsoleTestRunner.DoRunTests(ProjectContext projectContext, DotnetTestParams dotnetTestParams)
at Microsoft.DotNet.Tools.Test.TestCommand.DoRun(String[] args)
Environment data
dotnet --info output:
.NET Command Line Tools (1.0.0-preview1-002702)
Product Information:
Version: 1.0.0-preview1-002702
Commit Sha: 6cde21225e
Runtime Environment:
OS Name: ubuntu
OS Version: 15.10
OS Platform: Linux
RID: ubuntu.15.10-x6
About this issue
- Original URL
- State: open
- Created 8 years ago
- Reactions: 1
- Comments: 32 (6 by maintainers)
Commits related to this issue
- # Skip running tests due to tooling bug https://github.com/dotnet/cli/issues/3073 — committed to Dotnet-Boxed/Framework by RehanSaeed 8 years ago
- # Skip running tests due to tooling bug https://github.com/dotnet/cli/issues/3073 — committed to RehanSaeed/Serilog.Exceptions by RehanSaeed 8 years ago
I has been some time since this issue was raised. Is the above nasty workaround the only real solution at this point? The alternative being to wait for a preview3 tooling release?
If a net451 exe exists in the package, you will have to do a mono bootstrap script.
@borgdylan Thanks for your script. I’m using, with the following improvements:
Including your script at my test projects root directory
Putting the following configuration on
projector.json:Adding the following line to
.gitattributes:This way, your script always gets copied to output directory, and I’m able to run test as I would normally would:
dotnet testdotnet xunit is removed starting from xunit 2.4 Ref: Release Notes 2.4 Excerpt from the Release Notes:
So, for xunit framework test use the command
dotnet testSee Getting Started with xUnit.net Multi-targeting with non-Windows OSes
@AdamPD if you can upgrade your xunit project up to 2.3.0-beta3 you can use the
dotnet-xunittool which I added support for mono https://www.nuget.org/packages/dotnet-xunit/ https://github.com/xunit/xunit/pull/1213The bash script workaround no longer works when upgrading to the latest .NET SDK 1.0.1. The tests do run when using
mono xunit.console.exe test.dll, but dotnet test fails to find any “again”, specifying “‘TestAdapterPath’ does not contain any test adapters”, continues with “permission denied”, then exits.I confirm that
dotnet testdoes NOT work on linux when targetting net451.Setup:
project.json:
Output of
dotnet test:However, the build created directory bin/Debug/net451/debian.8-x64, from which I can manually run
dotnet-test-xunit.exe:Got it works with work around on Ubuntu 14.04 Project:
Failed:
dotnet test test/ProjectFolderTestSuccess:
mono test/ProjectFolderTest/bin/Debug/net451/ubuntu.14.04-x64/dotnet-test-xunit.exe test/ProjectFolderTest/bin/Debug/net451/ubuntu.14.04-x64/ProjectFolderTest.dllYou’re missing the testRunner entry. This may help: http://xunit.github.io/docs/getting-started-dotnet-core.html