Added Xcode Test Repetition support (available in Xcode 13+).
- New step inputs:
Test Repetition Mode,Maximum Test Repetitions, andRelaunch Tests for Each Repetition. -
Test Repetition Modeallows you to run your tests repeatedly in various ways, such as retry on failure and run until max repetitions. There are 4 options you can choose from:-
none: The tests won’t repeat. -
until_failure: Repeats a test until the test fails or until the maximum repetition. -
retry_on_failure: Failed tests run until they succeed or until the repetition number you specify. -
up_until_maximum_repetitions: Reruns all tests until maximum test repetition is reached regardless of the test outcomes.
-
-
Maximum Test Repetitionlets you specify the maximum number of times a test will repeat based on Test Repetition Mode. -
Relaunch Tests for Each Repetitionwill launch tests in a new process for each repetition if enabled.
Should retry tests on failure? step input is no longer available in Xcode 13+.
- If you enable
Should retry tests on failure?in Xcode 13+, your builds will fail with an error. - We recommend using the
retry_on_failureTest Repetition Mode instead (see above). This will retry only your failed tests and won’t restart the whole test suite.