specta: Test results intermittently disappear in the Xcode 7 UI
In my project, tests that use XCTestCase directly always show a green or red indicator in the editor gutter UI after running tests, but Specta tests intermittently show an empty grey diamond instead of a green or red diamond. When they disappear in the editor UI, they also disappear from the Issues Navigator.
The Specta test results always show up correctly if I go to the Report Navigator and look at the test results log.
I’m running Xcode 7.0.1 and Specta 1.0.4.
Is this a known issue?
About this issue
- Original URL
- State: open
- Created 9 years ago
- Comments: 18 (8 by maintainers)
I went to the Xcode lab in the WWDC today and found the guy who’s responsible for fixing this. I showed him the radar and he was aware of it, but besides raising the awareness for the amount of people that are affected by this bug, I couldn’t do much. Let’s hope this will get fixed in Xcode 8 GM.
If you use Specta or Quick and are disappointed with tests disappearing in Xcode’s Test Navigator, tests lingering in the Test Navigator despite no longer being defined, or even tests not being run, please read and duplicate this radar: https://openradar.appspot.com/26028557.
Xcode does not provide the Specta or Quick maintainers with an API to address these problems. The best way to contribute to fixing these issues is to communicate to the Apple XCTest team that this is a use case we wish they’d support better. The best way I know to do that is to ask you all to re-submit https://openradar.appspot.com/26028557. 🙇
Duped 👍
@orta: I filed a radar on this: Bug ID 25679988: Test cases disappear from the Test Navigator, on 12 April. Apple responded with: “It seems this issue only manifests when using the Specta framework. Can the developers of Specta resolve this issue?”
In response, on 20 April, I informed them that this issue also manifests itself in Quick, and that we have reason to believe it’s an Xcode issue. I haven’t gotten another response since.