Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support xcresulttool from Xcode 16 #10

Merged
merged 7 commits into from
Oct 29, 2024

Build `xcresulttool` code

6c699b3
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

Support xcresulttool from Xcode 16 #10

Build `xcresulttool` code
6c699b3
Select commit
Loading
Failed to load commit list.
GitHub Actions / Multiple Paths (xcode15) failed Oct 29, 2024 in 0s

Xcode test results

Testing project Weather with scheme Weather

Summary

TotalSuccess PassedFailure FailedSkipped SkippedExpected Failure Expected Failure⏱️ Time
11820112.25s

Test Summary

WeatherTests

  • Device: iPhone 13 mini, 15.0 (19A339)
  • SDK: Simulator - iOS 15.0, 15.0
TestTotalSuccessFailureSkippedExpected Failure
test-class WeatherTests32100

WeatherUITests

  • Device: iPhone 13 mini, 15.0 (19A339)
  • SDK: Simulator - iOS 15.0, 15.0
TestTotalSuccessFailureSkippedExpected Failure
test-class WeatherUITests443001
test-class WeatherUITestsLaunchTests43100

Failure Failures

WeatherTests/WeatherTests/testFail()

File/Users/katsumi/Develop/Weather/WeatherTests/WeatherTests.swift:23
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("1") is not equal to ("2")

WeatherUITests/WeatherUITestsLaunchTests/testLaunch()

File/Users/katsumi/Develop/Weather/WeatherUITests/WeatherUITestsLaunchTests.swift:28
Issue TypeAssertion Failure
Messagefailed - Fail!!

Testing workspace KeychainAccess with scheme KeychainAccess

Summary

TotalSuccess PassedFailure FailedSkipped SkippedExpected Failure Expected Failure⏱️ Time
918460112.28s

Test Summary

WeatherTests

  • Device: iPhone 13 mini, 15.0 (19A339)
  • SDK: Simulator - iOS 15.0, 15.0
TestTotalSuccessFailureSkippedExpected Failure
test-class WeatherTests32100

WeatherUITests

  • Device: iPhone 13 mini, 15.0 (19A339)
  • SDK: Simulator - iOS 15.0, 15.0
TestTotalSuccessFailureSkippedExpected Failure
test-class WeatherUITests443001
test-class WeatherUITestsLaunchTests43100

KeychainAccessTests

  • Device: iPhone 13 mini, 15.0 (19A339)
  • SDK: Simulator - iOS 15.0, 15.0
TestTotalSuccessFailureSkippedExpected Failure
test-class EnumTests44000
test-class ErrorTypeTests11000
test-class KeychainAccessTests3434000
test-class SharedCredentialTests22000

KeychainAccessTests-MacCatalyst

  • Device: iPhone 13 mini, 15.0 (19A339)
  • SDK: Simulator - iOS 15.0, 15.0
TestTotalSuccessFailureSkippedExpected Failure
test-class EnumTests44000
test-class ErrorTypeTests11000
test-class KeychainAccessTests3430400

Failure Failures

KeychainAccessTests-MacCatalyst/KeychainAccessTests/testAllKeys()

File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:1372
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:1374
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost")")
File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:1380
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:1382
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost")")
File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:1388
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:1390
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost")")
File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:1443
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:1451
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:1563
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")
File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:1565
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")
File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:1567
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")

KeychainAccessTests-MacCatalyst/KeychainAccessTests/testDefaultInitializer()

File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:465
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")

KeychainAccessTests-MacCatalyst/KeychainAccessTests/testInitializerWithAccessGroup()

File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:483
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")

KeychainAccessTests-MacCatalyst/KeychainAccessTests/testSetAttributes()

File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:773
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:855
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:913
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
File/Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift:972
Issue TypeAssertion Failure
MessageXCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")

Testing project TAU with scheme TAUUITests

Summary

TotalSuccess PassedFailure FailedSkipped SkippedExpected Failure Expected Failure⏱️ Time
948580130.59s

Test Summary

WeatherTests

  • Device: iPhone 13 mini, 15.0 (19A339)
  • SDK: Simulator - iOS 15.0, 15.0
TestTotalSuccessFailureSkippedExpected Failure
test-class WeatherTests32100

WeatherUITests

  • Device: iPhone 13 mini, 15.0 (19A339)
  • SDK: Simulator - iOS 15.0, 15.0
TestTotalSuccessFailureSkippedExpected Failure
test-class WeatherUITests443001
test-class WeatherUITestsLaunchTests43100

KeychainAccessTests

  • Device: iPhone 13 mini, 15.0 (19A339)
  • SDK: Simulator - iOS 15.0, 15.0
TestTotalSuccessFailureSkippedExpected Failure
test-class EnumTests44000
test-class ErrorTypeTests11000
test-class KeychainAccessTests3434000
test-class SharedCredentialTests22000

KeychainAccessTests-MacCatalyst

  • Device: iPhone 13 mini, 15.0 (19A339)
  • SDK: Simulator - iOS 15.0, 15.0
TestTotalSuccessFailureSkippedExpected Failure
test-class EnumTests44000
test-class ErrorTypeTests11000
test-class KeychainAccessTests3430400

TAUUITests

  • Device: iPhone 13 mini, 15.0 (19A339)
  • SDK: Simulator - iOS 15.0, 15.0
TestTotalSuccessFailureSkippedExpected Failure
test-class BDDTest10100
test-class TAUUITests21100

Failure Failures

TAUUITests/BDDTest/testThankYouMessageInBDStyle()

File/Users/katsumi/Downloads/XCUITest-TAU-chapter4/TAUUITests/BDDTest.swift:40
Issue TypeAssertion Failure
MessageFailed to synthesize event: Failed to scroll to visible (by AX action) Button, {{25.0, 500.0}, {330.0, 41.0}}, identifier: 'enrollButton', label: 'Enroll', error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58911, elementOrHash.elementID: 5661339664.11. (Underlying Error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58911, elementOrHash.elementID: 5661339664.11)

TAUUITests/TAUUITests/testThankYouMessage()

File/Users/katsumi/Downloads/XCUITest-TAU-chapter4/TAUUITests/TAUUITests.swift:24
Issue TypeAssertion Failure
MessageFailed to synthesize event: Failed to scroll to visible (by AX action) Button, {{25.0, 500.0}, {330.0, 41.0}}, identifier: 'enrollButton', label: 'Enroll', error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58971, elementOrHash.elementID: 4931535136.11. (Underlying Error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58971, elementOrHash.elementID: 4931535136.11)

Details

Test Details

WeatherTestsback

WeatherTests back

SuccessFailureSkippedExpected Failure⏱️
2 (67%)1 (33%)0 (0%)0 (0%)0.25s
Successtest-method testExample()
Failuretest-method testFail()back

Activities:
  • Assertion Failure at WeatherTests.swift:23: XCTAssertEqual failed: ("1") is not equal to ("2")
Successtest-method testPerformanceExample()

WeatherUITestsback

WeatherUITests4 back

SuccessFailureSkippedExpected Failure⏱️
3 (75%)0 (0%)0 (0%)1 (25%)4.79s
Successtest-method testExample()

Activities:
  • Start Test at 2021-10-17 22:17:29.828
  • Some screenshots were deleted because testing is configured to remove automatic screenshots on success.
  • Set Up
  • Open com.kishikawakatsumi.Weather
    • Launch com.kishikawakatsumi.Weather
      • Setting up automation session
      • Wait for com.kishikawakatsumi.Weather to idle
  • Tear Down
Expected Failuretest-method testExpedtedFailures()

Activities:
  • Start Test at 2021-10-17 22:17:33.598
  • Set Up
  • Tear Down
Successtest-method testFail()

Activities:
  • Start Test at 2021-10-17 22:17:33.630
  • Some screenshots were deleted because testing is configured to remove automatic screenshots on success.
  • Set Up
  • Tear Down
Successtest-method testSkipped()

Activities:
  • Start Test at 2021-10-17 22:17:33.644
  • Some screenshots were deleted because testing is configured to remove automatic screenshots on success.
  • Set Up
  • Open com.kishikawakatsumi.Weather
    • Launch com.kishikawakatsumi.Weather
      • Terminate com.kishikawakatsumi.Weather:33088
      • Setting up automation session
      • Wait for com.kishikawakatsumi.Weather to idle
  • Tear Down

WeatherUITestsLaunchTests back

SuccessFailureSkippedExpected Failure⏱️
3 (75%)1 (25%)0 (0%)0 (0%)7.21s
Mixed FailureSuccess test-method testLaunch()

Configuration:
XCUIAppearanceMode: 1, XCUIDeviceOrientation: 1

Activities:
  • Setting device orientation to Portrait
    • Wait for com.kishikawakatsumi.Weather to idle
  • Some screenshots were deleted because testing is configured to remove automatic screenshots on success.
  • Setting appearance mode to Light
    • Wait for com.kishikawakatsumi.Weather to idle
  • Start Test at 2021-10-17 22:17:38.799
  • Set Up
  • Open com.kishikawakatsumi.Weather
    • Launch com.kishikawakatsumi.Weather
      • Terminate com.kishikawakatsumi.Weather:33095
      • Setting up automation session
      • Wait for com.kishikawakatsumi.Weather to idle
  • Find the Target Application 'com.kishikawakatsumi.Weather'
  • Added attachment named 'Launch Screen'
  • Tear Down
Success test-method testLaunch()

Configuration:
XCUIAppearanceMode: 1, XCUIDeviceOrientation: 4

Activities:
  • Setting device orientation to Landscape Right
    • Wait for com.kishikawakatsumi.Weather to idle
  • Some screenshots were deleted because testing is configured to remove automatic screenshots on success.
  • Setting appearance mode to Light
    • Wait for com.kishikawakatsumi.Weather to idle
  • Start Test at 2021-10-17 22:17:45.921
  • Set Up
  • Open com.kishikawakatsumi.Weather
    • Launch com.kishikawakatsumi.Weather
      • Terminate com.kishikawakatsumi.Weather:33096
      • Setting up automation session
      • Wait for com.kishikawakatsumi.Weather to idle
  • Find the Target Application 'com.kishikawakatsumi.Weather'
  • Added attachment named 'Launch Screen'
  • Tear Down
Failure test-method testLaunch()back

Configuration:
XCUIAppearanceMode: 2, XCUIDeviceOrientation: 1

Activities:
  • Setting device orientation to Portrait
    • Wait for com.kishikawakatsumi.Weather to idle
  • Setting appearance mode to Dark
    • Wait for com.kishikawakatsumi.Weather to idle
  • Start Test at 2021-10-17 22:17:51.210
  • Set Up
  • Open com.kishikawakatsumi.Weather
    • Launch com.kishikawakatsumi.Weather
      • Terminate com.kishikawakatsumi.Weather:33100
      • Setting up automation session
      • Wait for com.kishikawakatsumi.Weather to idle
  • Find the Target Application 'com.kishikawakatsumi.Weather'
  • Added attachment named 'Launch Screen'
  • Assertion Failure at WeatherUITestsLaunchTests.swift:28: failed - Fail!!
  • Tear Down
Success test-method testLaunch()

Configuration:
XCUIAppearanceMode: 2, XCUIDeviceOrientation: 4

Activities:
  • Setting device orientation to Landscape Right
    • Wait for com.kishikawakatsumi.Weather to idle
  • Some screenshots were deleted because testing is configured to remove automatic screenshots on success.
  • Setting appearance mode to Dark
    • Wait for com.kishikawakatsumi.Weather to idle
  • Start Test at 2021-10-17 22:17:58.445
  • Set Up
  • Open com.kishikawakatsumi.Weather
    • Launch com.kishikawakatsumi.Weather
      • Terminate com.kishikawakatsumi.Weather:33105
      • Setting up automation session
      • Wait for com.kishikawakatsumi.Weather to idle
  • Find the Target Application 'com.kishikawakatsumi.Weather'
  • Added attachment named 'Launch Screen'
  • Tear Down

Test Details

KeychainAccessTestsback

EnumTests back

SuccessFailureSkippedExpected Failure⏱️
4 (100%)0 (0%)0 (0%)0 (0%)0.00s
Successtest-method testAccessibility()
Successtest-method testAuthenticationType()
Successtest-method testItemClass()
Successtest-method testProtocolType()

ErrorTypeTests back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.00s
Successtest-method testErrorType()

KeychainAccessTests back

SuccessFailureSkippedExpected Failure⏱️
34 (100%)0 (0%)0 (0%)0 (0%)0.01s
Successtest-method testAllKeys()
Successtest-method testAuthenticationPolicy()
Successtest-method testContains()
Successtest-method testDefaultInitializer()
Successtest-method testDescription()
Successtest-method testErrorHandling()
Successtest-method testGenericPassword()
Successtest-method testGenericPasswordSubscripting()
Successtest-method testGenericPasswordWithAccessGroup1()
Successtest-method testGenericPasswordWithAccessGroup2()
Successtest-method testGetPersistentRef()
Successtest-method testIgnoringAttributeSynchronizable()
Successtest-method testIgnoringAttributeSynchronizableBackwardCompatibility()
Successtest-method testInitializerWithAccessGroup()
Successtest-method testInitializerWithServer()
Successtest-method testInitializerWithServerAndAuthenticationType()
Successtest-method testInitializerWithService()
Successtest-method testInitializerWithServiceAndAccessGroup()
Successtest-method testInternetPassword()
Successtest-method testInternetPasswordSubscripting()
Successtest-method testInternetPasswordWithAccessGroup1()
Successtest-method testInternetPasswordWithAccessGroup2()
Successtest-method testProperties()
Successtest-method testRemoveData()
Successtest-method testRemoveString()
Successtest-method testSetAttributes()
Successtest-method testSetData()
Successtest-method testSetString()
Successtest-method testSetStringWithComment()
Successtest-method testSetStringWithCustomService()
Successtest-method testSetStringWithLabel()
Successtest-method testSetStringWithLabelAndComment()
Successtest-method testStringConversionError()
Successtest-method testSubscripting()

SharedCredentialTests back

SuccessFailureSkippedExpected Failure⏱️
2 (100%)0 (0%)0 (0%)0 (0%)0.00s
Successtest-method testGeneratePassword()
Successtest-method testGetSharedPassword()

KeychainAccessTests-MacCatalystback

EnumTests back

SuccessFailureSkippedExpected Failure⏱️
4 (100%)0 (0%)0 (0%)0 (0%)0.00s
Successtest-method testAccessibility()
Successtest-method testAuthenticationType()
Successtest-method testItemClass()
Successtest-method testProtocolType()

ErrorTypeTests back

SuccessFailureSkippedExpected Failure⏱️
1 (100%)0 (0%)0 (0%)0 (0%)0.00s
Successtest-method testErrorType()

KeychainAccessTests back

SuccessFailureSkippedExpected Failure⏱️
30 (88%)4 (12%)0 (0%)0 (0%)0.01s
Failuretest-method testAllKeys()back

Activities:
  • Assertion Failure at KeychainAccessTests.swift:1372: XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
  • Assertion Failure at KeychainAccessTests.swift:1374: XCTAssertEqual failed: ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost")")
  • Assertion Failure at KeychainAccessTests.swift:1380: XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
  • Assertion Failure at KeychainAccessTests.swift:1382: XCTAssertEqual failed: ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost")")
  • Assertion Failure at KeychainAccessTests.swift:1388: XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
  • Assertion Failure at KeychainAccessTests.swift:1390: XCTAssertEqual failed: ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost")")
  • Assertion Failure at KeychainAccessTests.swift:1443: XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
  • Assertion Failure at KeychainAccessTests.swift:1451: XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
  • Assertion Failure at KeychainAccessTests.swift:1563: XCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")
  • Assertion Failure at KeychainAccessTests.swift:1565: XCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")
  • Assertion Failure at KeychainAccessTests.swift:1567: XCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")
Successtest-method testAuthenticationPolicy()
Successtest-method testContains()
Failuretest-method testDefaultInitializer()back

Activities:
  • Assertion Failure at KeychainAccessTests.swift:465: XCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")
Successtest-method testDescription()
Successtest-method testErrorHandling()
Successtest-method testGenericPassword()
Successtest-method testGenericPasswordSubscripting()
Successtest-method testGenericPasswordWithAccessGroup1()
Successtest-method testGenericPasswordWithAccessGroup2()
Successtest-method testGetPersistentRef()
Successtest-method testIgnoringAttributeSynchronizable()
Successtest-method testIgnoringAttributeSynchronizableBackwardCompatibility()
Failuretest-method testInitializerWithAccessGroup()back

Activities:
  • Assertion Failure at KeychainAccessTests.swift:483: XCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")
Successtest-method testInitializerWithServer()
Successtest-method testInitializerWithServerAndAuthenticationType()
Successtest-method testInitializerWithService()
Successtest-method testInitializerWithServiceAndAccessGroup()
Successtest-method testInternetPassword()
Successtest-method testInternetPasswordSubscripting()
Successtest-method testInternetPasswordWithAccessGroup1()
Successtest-method testInternetPasswordWithAccessGroup2()
Successtest-method testProperties()
Successtest-method testRemoveData()
Successtest-method testRemoveString()
Failuretest-method testSetAttributes()back

Activities:
  • Assertion Failure at KeychainAccessTests.swift:773: XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
  • Assertion Failure at KeychainAccessTests.swift:855: XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
  • Assertion Failure at KeychainAccessTests.swift:913: XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
  • Assertion Failure at KeychainAccessTests.swift:972: XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")
Successtest-method testSetData()
Successtest-method testSetString()
Successtest-method testSetStringWithComment()
Successtest-method testSetStringWithCustomService()
Successtest-method testSetStringWithLabel()
Successtest-method testSetStringWithLabelAndComment()
Successtest-method testStringConversionError()
Successtest-method testSubscripting()

Test Details

TAUUITestsback

BDDTest back

SuccessFailureSkippedExpected Failure⏱️
0 (0%)1 (100%)0 (0%)0 (0%)10.16s
Failuretest-method testThankYouMessageInBDStyle()back

Activities:
  • Start Test at 2021-10-17 02:43:13.407
  • Set Up
    • Open com.shashikant.TAU
      • Launch com.shashikant.TAU
        • Terminate com.shashikant.TAU:31875
        • Setting up automation session
        • Wait for com.shashikant.TAU to idle
  • Given App is ready
    • Checking existence of "enrollButton" Button
  • When I enter city London
    • Tap "city" TextField
      • Wait for com.shashikant.TAU to idle
      • Find the "city" TextField
      • Check for interrupting elements affecting "city" TextField
      • Synthesize event
      • Wait for com.shashikant.TAU to idle
    • Type 'London' into "city" TextField
      • Wait for com.shashikant.TAU to idle
      • Find the "city" TextField
      • Check for interrupting elements affecting "city" TextField
      • Synthesize event
      • Wait for com.shashikant.TAU to idle
  • When I Enrolled
    • Tap "enrollButton" Button
      • Wait for com.shashikant.TAU to idle
      • Find the "enrollButton" Button
      • Check for interrupting elements affecting "enrollButton" Button
      • Synthesize event
        • Scroll element to visible
        • Failed: Failed to scroll to visible (by AX action) Button, {{25.0, 500.0}, {330.0, 41.0}}, identifier: 'enrollButton', label: 'Enroll', error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58911, elementOrHash.elementID: 5661339664.11
      • Retrying Tap "enrollButton" Button (attempt #2)
        • Wait for com.shashikant.TAU to idle
        • Find the "enrollButton" Button
        • Check for interrupting elements affecting "enrollButton" Button
        • Synthesize event
          • Scroll element to visible
          • Failed: Failed to scroll to visible (by AX action) Button, {{25.0, 500.0}, {330.0, 41.0}}, identifier: 'enrollButton', label: 'Enroll', error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58911, elementOrHash.elementID: 5661339664.11
      • Retrying Tap "enrollButton" Button (attempt #3)
        • Wait for com.shashikant.TAU to idle
        • Find the "enrollButton" Button
        • Check for interrupting elements affecting "enrollButton" Button
        • Synthesize event
          • Scroll element to visible
          • Failed: Failed to scroll to visible (by AX action) Button, {{25.0, 500.0}, {330.0, 41.0}}, identifier: 'enrollButton', label: 'Enroll', error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58911, elementOrHash.elementID: 5661339664.11
      • Assertion Failure at BDDTest.swift:40: Failed to synthesize event: Failed to scroll to visible (by AX action) Button, {{25.0, 500.0}, {330.0, 41.0}}, identifier: 'enrollButton', label: 'Enroll', error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58911, elementOrHash.elementID: 5661339664.11. (Underlying Error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58911, elementOrHash.elementID: 5661339664.11)
  • Tear Down
    • Terminate com.shashikant.TAU:58911

TAUUITests back

SuccessFailureSkippedExpected Failure⏱️
1 (50%)1 (50%)0 (0%)0 (0%)8.15s
Successtest-method testAllElementsOfMainScreen()

Activities:
  • Start Test at 2021-10-17 02:43:23.565
  • Some screenshots were deleted because testing is configured to remove automatic screenshots on success.
  • Set Up
    • Open com.shashikant.TAU
      • Launch com.shashikant.TAU
        • Setting up automation session
        • Wait for com.shashikant.TAU to idle
  • Tap "welcomeMessage" StaticText
    • Wait for com.shashikant.TAU to idle
    • Find the "welcomeMessage" StaticText
    • Check for interrupting elements affecting "welcomeMessage" StaticText
    • Synthesize event
    • Wait for com.shashikant.TAU to idle
  • Tap "enterCity" StaticText
    • Wait for com.shashikant.TAU to idle
    • Find the "enterCity" StaticText
    • Check for interrupting elements affecting "enterCity" StaticText
    • Synthesize event
    • Wait for com.shashikant.TAU to idle
  • Tap "enrollButton" Button
    • Wait for com.shashikant.TAU to idle
    • Find the "enrollButton" Button
    • Check for interrupting elements affecting "enrollButton" Button
    • Synthesize event
    • Wait for com.shashikant.TAU to idle
  • Tap "TAUlogo" Image
    • Wait for com.shashikant.TAU to idle
    • Find the "TAUlogo" Image
    • Check for interrupting elements affecting "TAUlogo" Image
    • Synthesize event
    • Wait for com.shashikant.TAU to idle
  • Checking existence of "Please Enter City" StaticText
  • Tear Down
    • Terminate com.shashikant.TAU:58931
Failuretest-method testThankYouMessage()back

Activities:
  • Start Test at 2021-10-17 02:43:29.414
  • Set Up
    • Open com.shashikant.TAU
      • Launch com.shashikant.TAU
        • Setting up automation session
        • Wait for com.shashikant.TAU to idle
  • Tap "city" TextField
    • Wait for com.shashikant.TAU to idle
    • Find the "city" TextField
    • Check for interrupting elements affecting "city" TextField
    • Synthesize event
    • Wait for com.shashikant.TAU to idle
  • Type 'London' into "city" TextField
    • Wait for com.shashikant.TAU to idle
    • Find the "city" TextField
    • Check for interrupting elements affecting "city" TextField
    • Synthesize event
    • Wait for com.shashikant.TAU to idle
  • Tap "enrollButton" Button
    • Wait for com.shashikant.TAU to idle
    • Find the "enrollButton" Button
    • Check for interrupting elements affecting "enrollButton" Button
    • Synthesize event
      • Scroll element to visible
      • Failed: Failed to scroll to visible (by AX action) Button, {{25.0, 500.0}, {330.0, 41.0}}, identifier: 'enrollButton', label: 'Enroll', error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58971, elementOrHash.elementID: 4931535136.11
    • Retrying Tap "enrollButton" Button (attempt #2)
      • Wait for com.shashikant.TAU to idle
      • Find the "enrollButton" Button
      • Check for interrupting elements affecting "enrollButton" Button
      • Synthesize event
        • Scroll element to visible
        • Failed: Failed to scroll to visible (by AX action) Button, {{25.0, 500.0}, {330.0, 41.0}}, identifier: 'enrollButton', label: 'Enroll', error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58971, elementOrHash.elementID: 4931535136.11
    • Retrying Tap "enrollButton" Button (attempt #3)
      • Wait for com.shashikant.TAU to idle
      • Find the "enrollButton" Button
      • Check for interrupting elements affecting "enrollButton" Button
      • Synthesize event
        • Scroll element to visible
        • Failed: Failed to scroll to visible (by AX action) Button, {{25.0, 500.0}, {330.0, 41.0}}, identifier: 'enrollButton', label: 'Enroll', error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58971, elementOrHash.elementID: 4931535136.11
    • Assertion Failure at TAUUITests.swift:24: Failed to synthesize event: Failed to scroll to visible (by AX action) Button, {{25.0, 500.0}, {330.0, 41.0}}, identifier: 'enrollButton', label: 'Enroll', error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58971, elementOrHash.elementID: 4931535136.11. (Underlying Error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58971, elementOrHash.elementID: 4931535136.11)
  • Tear Down
    • Terminate com.shashikant.TAU:58971

Annotations

Check failure on line 23 in WeatherTests/WeatherTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("1") is not equal to ("2")

Check failure on line 28 in WeatherUITests/WeatherUITestsLaunchTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

failed - Fail!!

Check failure on line 1372 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")

Check failure on line 1374 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost")")

Check failure on line 1380 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")

Check failure on line 1382 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost")")

Check failure on line 1388 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")

Check failure on line 1390 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("com.kishikawakatsumi.KeychainAccess.TestHost")")

Check failure on line 1443 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")

Check failure on line 1451 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")

Check failure on line 1563 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")

Check failure on line 1565 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")

Check failure on line 1567 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")

Check failure on line 465 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")

Check failure on line 483 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst") is not equal to ("com.kishikawakatsumi.KeychainAccess.TestHost")

Check failure on line 773 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")

Check failure on line 855 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")

Check failure on line 913 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")

Check failure on line 972 in /Users/katsumi/Documents/XcodeProjects/KeychainAccess/Lib/TestHost-MacCatalyst/KeychainAccessTests-MacCatalyst/KeychainAccessTests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

XCTAssertEqual failed: ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost-MacCatalyst")") is not equal to ("Optional("27AEDK3C9F.com.kishikawakatsumi.KeychainAccess.TestHost")")

Check failure on line 40 in /Users/katsumi/Downloads/XCUITest-TAU-chapter4/TAUUITests/BDDTest.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

Failed to synthesize event: Failed to scroll to visible (by AX action) Button, {{25.0, 500.0}, {330.0, 41.0}}, identifier: 'enrollButton', label: 'Enroll', error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58911, elementOrHash.elementID: 5661339664.11. (Underlying Error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58911, elementOrHash.elementID: 5661339664.11)

Check failure on line 24 in /Users/katsumi/Downloads/XCUITest-TAU-chapter4/TAUUITests/TAUUITests.swift

See this annotation in the file changed.

@github-actions github-actions / Multiple Paths (xcode15)

Assertion Failure

Failed to synthesize event: Failed to scroll to visible (by AX action) Button, {{25.0, 500.0}, {330.0, 41.0}}, identifier: 'enrollButton', label: 'Enroll', error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58971, elementOrHash.elementID: 4931535136.11. (Underlying Error: Error kAXErrorCannotComplete performing AXAction kAXScrollToVisibleAction on element AX element pid: 58971, elementOrHash.elementID: 4931535136.11)