Skip to content

Releases: bitrise-steplib/steps-xcode-test

4.0.1

08 Oct 11:03
c26acd3
Compare
Choose a tag to compare

Updated dependencies (including go-xcode).

4.0.0

07 Oct 07:27
14b5cf6
Compare
Choose a tag to compare

Revamped the step's input structure.

  • Replaced simulator_device, simulator_os_version, and simulator_platform inputs with destination. This is passed to xcodebuild as the -destination parameter. For example, if you previously used simulator_device: iPhone 8 Plus, simulator_os_version: 15.0, and simulator_platform: iOS Simulator, destination should be platform=iOS Simulator,name=iPhone 8 Plus,OS=15.0.
  • New input: Build settings (xcconfig_content). Allows you to override the project's build settings. Creates a temporary file with the given input value as content and passes it to xcodebuild as the -xcconfig parameter.
  • Renamed is_clean_build input to perform_clean_action.
  • Renamed xcodebuild_test_options input to xcodebuild_options.
  • Renamed output_tool input to log_formatter.
  • Renamed xcpretty_test_options input to xcpretty_options.
  • Renamed verbose input to verbose_log.
  • Removed export_uitest_artifacts input since this is no longer supported on modern Xcode versions.
  • Removed generate_code_coverage_files input in favor of xcconfig_content. If you'd like to generate legacy code coverage files, you should add GCC_INSTRUMENT_PROGRAM_FLOW_ARCS=YES and GCC_GENERATE_TEST_COVERAGE_FILES=YES separated by newline characters (\n) to the xcconfig_content input.
  • Removed disable_index_while_building input since this is no longer an issue on modern Xcode versions.
  • Removed single_build input because should_build_before_test is removed (they were used in conjunction).
  • Removed should_build_before_test input since this is no longer an issue on modern Xcode versions.
  • Re-organized categories.
  • Updated titles, summaries, and descriptions.

3.1.0

07 Sep 09:15
825db06
Compare
Choose a tag to compare

#181 Step refactor in order to make it unit-testable, no change on the public API.

3.0.2

04 Aug 13:01
5853101
Compare
Choose a tag to compare

(#178) Will rerun tests if encountering transient Xcode Simulator error: The request was denied by service delegate (SBMainWorkspace).

3.0.1

26 Jul 13:29
9f99f53
Compare
Choose a tag to compare

Add workaround for Big Sur simulator boot failure (#177)

3.0.0

26 Jul 12:02
9f99f53
Compare
Choose a tag to compare

Added Xcode Test Repetition support (available in Xcode 13+).

  • New step inputs: Test Repetition Mode, Maximum Test Repetitions, and Relaunch Tests for Each Repetition.
  • Test Repetition Mode allows you to run your tests repeatedly in various ways, such as retry on failure and run until max repetitions. There are 4 options you can choose from:
    • none: The tests won’t repeat.
    • until_failure: Repeats a test until the test fails or until the maximum repetition.
    • retry_on_failure: Failed tests run until they succeed or until the repetition number you specify.
    • up_until_maximum_repetitions: Reruns all tests until maximum test repetition is reached regardless of the test outcomes.
  • Maximum Test Repetition lets you specify the maximum number of times a test will repeat based on Test Repetition Mode.
  • Relaunch Tests for Each Repetition will launch tests in a new process for each repetition if enabled.

Should retry tests on failure? step input is no longer available in Xcode 13+.

  • If you enable Should retry tests on failure? in Xcode 13+, your builds will fail with an error.
  • We recommend using the retry_on_failure Test Repetition Mode instead (see above). This will retry only your failed tests and won't restart the whole test suite.

2.7.1

07 Jul 13:21
9291499
Compare
Choose a tag to compare

Fix xcodebuild test command log filename in the Step log.

2.7.0

07 Jul 10:05
13e1022
Compare
Choose a tag to compare

Added support for Xcode Test Plan and improved failed test retry.

  • New step input: test_plan.
  • Starting from Xcode 13, failed tests will be retried using Xcode Test Repetition (if should_retry_test_on_fail is enabled).
  • Replaced BITRISE_XCODE_RAW_TEST_RESULT_TEXT_PATH environment variable with BITRISE_XCODEBUILD_BUILD_LOG_PATH and BITRISE_XCODEBUILD_TEST_LOG_PATH.
  • .xcresult is now deployed as a ZIP artifact and exposed under the BITRISE_XCRESULT_ZIP_PATH environment variable.

2.6.3

02 Jun 14:26
54bd177
Compare
Choose a tag to compare

Removed unused Working directory (workdir) Input.

2.6.2

11 May 08:01
1a66f76
Compare
Choose a tag to compare

Added a retry for the simctl list command, to prevent errors like:

error: no simulators found for os version: iOS 14.1
error: failed to determin latest (iOS) simulator version