Xcode Test for iOS v2.1.0

Changelog
1

Fixed an issue, where exporting screenshots did not succeed in case of failing UI tests, with the error message:
Failed to update screenshot names, error: screenshot not exists.

Exported screenshots have a different format, which now contains the test identifier, ios_simple_objcUITests-testExample_2019-01-10_11-05-49_screenshot_A0E6A26C-40C4-49E0-BBCB-47C9D023E772.png instead of the previously used 2019-01-10_11-02-59_Screenshot of main screen (ID 1)_1_F970609B-056A-4F4F-A337-FB586A03EDE5.png. Failing tests’ screenshots are now placed under the Failures directory.

Fixed an issue occurring in a development environment, in the case if the XCode DerivedData directory contained different builds of the same project:
Failed to export UI test artifacts, error more than 1 project derived data dir found.

2

Just a heads up to anyone using 2.1.0, this caused an error exporting the coverage information to downstream steps. See https://github.com/bitrise-io/steps-xcode-test/issues/103 and https://github.com/bitrise-io/steps-xcode-test/issues/104.

1 Like
3

Was fixed in 2.1.1 ( Xcode Test for iOS v2.1.1 ) right @rwalberg?

4

Hi Viktor, I’d gone back to 2.0.0 so I wasn’t using 2.1.1 yet.

I tried 2.1.1 just now and it is still broken:

[15:06:54]: $ xcodebuild -showBuildSettings -workspace PagerDuty.xcworkspace -scheme PagerDuty
[15:06:57]: Command timed out after 3 seconds on try 1 of 4, trying again with a 6 second timeout...
[15:07:01]: Unable to find any .xccoverage file.
[15:07:01]: Make sure you have enabled 'Gather code coverage' setting on your scheme settings.
[15:07:01]: Alternatively you can provide the full path to your .xccoverage file.
[!] The exception involves the following plugins:
 -  danger-xcov
/usr/local/lib/ruby/gems/2.5.0/gems/xcov-1.5.0/lib/xcov/error_handler.rb:20:in `handle_error':  (Danger::DSLError)
[!] Invalid `Dangerfile` file: Error creating your coverage report - see the log above. Updating the Danger gem might fix the issue. Your Danger version: 5.11.1, latest Danger version: 5.14.0
 #  from Dangerfile:11
 #  -------------------------------------------
 #  
 >  xcov.report(
 #      scheme: 'PagerDuty',
 #  -------------------------------------------
	from /usr/local/lib/ruby/gems/2.5.0/gems/xcov-1.5.0/lib/xcov/manager.rb:45:in `parse_xccoverage'
	from /usr/local/lib/ruby/gems/2.5.0/gems/danger-xcov-0.4.1/lib/danger_plugin.rb:64:in `produce_report'
	from /usr/local/lib/ruby/gems/2.5.0/gems/danger-xcov-0.4.1/lib/danger_plugin.rb:36:in `report'
	from Dangerfile:11:in `eval_file'

Thanks for your efforts!

5

Hy @rwalberg

So is it working with 2.0 and fails with 2.1 and up?

6

Yep, it works with 2.0.0, fails on 2.1.0, fails on 2.1.1.

1 Like
7

Thank you for confirming!

8

This topic was automatically closed after 90 days. New replies are no longer allowed.