runtime: iOS Simulator test runs don't find simulator

Title. Multiple simulators are installed via XCode, including the latest. Running the XCode project manually works fine.

Log:

ryan@kenshin:~/git/runtime$ ./dotnet.sh build src/libraries/System.Threading.Timer/tests/ /t:test /p:targetos=iOSSimulator /p:targetarchitecture=x64
Microsoft (R) Build Engine version 16.10.0-preview-21126-01+6819f7ab0 for .NET
Copyright (C) Microsoft Corporation. All rights reserved.

  Determining projects to restore...
  All projects are up-to-date for restore.
  System.Security.Principal.Windows -> /Users/ryan/git/runtime/artifacts/bin/System.Security.Principal.Windows/ref/netstandard2.0-Debug/System.Security.Principal.Windows.dll
  System.Security.AccessControl -> /Users/ryan/git/runtime/artifacts/bin/System.Security.AccessControl/ref/netstandard2.0-Debug/System.Security.AccessControl.dll
  Microsoft.Win32.Registry -> /Users/ryan/git/runtime/artifacts/bin/Microsoft.Win32.Registry/ref/netstandard2.0-Debug/Microsoft.Win32.Registry.dll
  System.Runtime -> /Users/ryan/git/runtime/artifacts/bin/System.Runtime/ref/net6.0-Debug/System.Runtime.dll
  System.Security.Principal -> /Users/ryan/git/runtime/artifacts/bin/System.Security.Principal/ref/net6.0-Debug/System.Security.Principal.dll
  System.Runtime.Extensions -> /Users/ryan/git/runtime/artifacts/bin/System.Runtime.Extensions/ref/net6.0-Debug/System.Runtime.Extensions.dll
  System.Collections -> /Users/ryan/git/runtime/artifacts/bin/System.Collections/ref/net6.0-Debug/System.Collections.dll
  System.ComponentModel -> /Users/ryan/git/runtime/artifacts/bin/System.ComponentModel/ref/net6.0-Debug/System.ComponentModel.dll
  Microsoft.Win32.Primitives -> /Users/ryan/git/runtime/artifacts/bin/Microsoft.Win32.Primitives/ref/net6.0-Debug/Microsoft.Win32.Primitives.dll
  System.ObjectModel -> /Users/ryan/git/runtime/artifacts/bin/System.ObjectModel/ref/net6.0-Debug/System.ObjectModel.dll
  System.Runtime.InteropServices -> /Users/ryan/git/runtime/artifacts/bin/System.Runtime.InteropServices/ref/net6.0-Debug/System.Runtime.InteropServices.dll
  System.Collections.NonGeneric -> /Users/ryan/git/runtime/artifacts/bin/System.Collections.NonGeneric/ref/net6.0-Debug/System.Collections.NonGeneric.dll
  System.Memory -> /Users/ryan/git/runtime/artifacts/bin/System.Memory/ref/net6.0-Debug/System.Memory.dll
  System.ComponentModel.Primitives -> /Users/ryan/git/runtime/artifacts/bin/System.ComponentModel.Primitives/ref/net6.0-Debug/System.ComponentModel.Primitives.dll
  System.Net.Primitives -> /Users/ryan/git/runtime/artifacts/bin/System.Net.Primitives/ref/net6.0-Debug/System.Net.Primitives.dll
  System.Collections.Specialized -> /Users/ryan/git/runtime/artifacts/bin/System.Collections.Specialized/ref/net6.0-Debug/System.Collections.Specialized.dll
  System.Net.WebSockets -> /Users/ryan/git/runtime/artifacts/bin/System.Net.WebSockets/ref/net6.0-Debug/System.Net.WebSockets.dll
  System.Security.Claims -> /Users/ryan/git/runtime/artifacts/bin/System.Security.Claims/ref/net6.0-Debug/System.Security.Claims.dll
  System.Security.Principal.Windows -> /Users/ryan/git/runtime/artifacts/bin/System.Security.Principal.Windows/ref/net6.0-Debug/System.Security.Principal.Windows.dll
  System.Security.AccessControl -> /Users/ryan/git/runtime/artifacts/bin/System.Security.AccessControl/ref/net6.0-Debug/System.Security.AccessControl.dll
  TestUtilities -> /Users/ryan/git/runtime/artifacts/bin/TestUtilities/net6.0-Debug/TestUtilities.dll
  System.Threading.Timer.Tests -> /Users/ryan/git/runtime/artifacts/bin/System.Threading.Timer.Tests/net6.0-Debug/iossimulator-x64/System.Threading.Timer.Tests.dll
  System.Threading.Timer.Tests -> /Users/ryan/git/runtime/artifacts/bin/System.Threading.Timer.Tests/net6.0-Debug/iossimulator-x64/publish/
  Running: xcrun --sdk iphonesimulator --show-sdk-path
  Using working directory: /Users/ryan/git/runtime/src/libraries/System.Threading.Timer/tests
  Running: cmake -S. -BSystem.Threading.Timer.Tests -GXcode -DCMAKE_SYSTEM_NAME=iOS -DCMAKE_OSX_DEPLOYMENT_TARGET=10.1
  Using working directory: /Users/ryan/git/runtime/artifacts/bin/System.Threading.Timer.Tests/net6.0-Debug/iossimulator-x64/AppBundle/
  Running: xcodebuild ONLY_ACTIVE_ARCH=YES -allowProvisioningUpdates DEVELOPMENT_TEAM= -arch x86_64 -sdk iphonesimulator -configuration Release
  Using working directory: /Users/ryan/git/runtime/artifacts/bin/System.Threading.Timer.Tests/net6.0-Debug/iossimulator-x64/AppBundle/System.Threading.Timer.Tests
  
  APP size: 40 Mb.
  
  Xcode: /Users/ryan/git/runtime/artifacts/bin/System.Threading.Timer.Tests/net6.0-Debug/iossimulator-x64/AppBundle/System.Threading.Timer.Tests/System.Threading.Timer.Tests.xcodeproj
  App: /Users/ryan/git/runtime/artifacts/bin/System.Threading.Timer.Tests/net6.0-Debug/iossimulator-x64/AppBundle/System.Threading.Timer.Tests/Release-iphonesimulator/System.Threading.Timer.Tests.app
  XHarness command issued: apple test --app=/Users/ryan/git/runtime/artifacts/bin/System.Threading.Timer.Tests/net6.0-Debug/iossimulator-x64/AppBundle/System.Threading.Timer.Tests/Release-iphonesimulator/System.Threading.Timer.Tests.app --targets=ios-simulator-64 --xcode=/Applications/Xcode.app/Contents/Developer/../.. --output-directory=/Users/ryan/git/runtime/artifacts/bin/System.Threading.Timer.Tests/net6.0-Debug/iossimulator-x64/AppBundle/xharness-output
  info: Preparing run for ios-simulator-64
  info: Getting app bundle information..
  info: Starting application 'System.Threading.Timer.Tests' on ios-simulator-64
  fail: Failed to find suitable device for target ios-simulator-64
        Please make sure suitable Simulator is installed in Xcode
  XHarness exit code: 81 (DEVICE_NOT_FOUND)
  XHarness artifacts: /Users/ryan/git/runtime/artifacts/bin/System.Threading.Timer.Tests/net6.0-Debug/iossimulator-x64/AppBundle/xharness-output
/Users/ryan/git/runtime/eng/testing/tests.targets(117,5): error : One or more tests failed while running tests from 'System.Threading.Timer.Tests'. [/Users/ryan/git/runtime/src/libraries/System.Threading.Timer/tests/System.Threading.Timer.Tests.csproj]

Build FAILED.

/Users/ryan/git/runtime/eng/testing/tests.targets(117,5): error : One or more tests failed while running tests from 'System.Threading.Timer.Tests'. [/Users/ryan/git/runtime/src/libraries/System.Threading.Timer/tests/System.Threading.Timer.Tests.csproj]
    0 Warning(s)
    1 Error(s)

Time Elapsed 00:00:31.45

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Comments: 22 (21 by maintainers)

Most upvoted comments

@CoffeeFlux just FYI - didn’t forget about this 😃

There is a PR where I change how we find devices, install apps and run them and it should give us more details and more logs about your environment: https://github.com/dotnet/xharness/pull/538

Unfortunately, it is waiting on a fix in mlaunch but I have a PR for that already, just waiting on a merge.