ci: set fail-fast as False to allow integration tests to continue on nightly Tutor failures

[magajh]

Description

This PR updates the Tutor Integration Tests workflow to ensure that failures in the nightly version of Tutor do not cancel the execution of tests for stable versions (<18.0.0 and <19.0.0). fail-fast: false is added to the strategy, allowing the workflow to proceed even if nightly fails.

This change is important because the nightly version of Tutor is not stable and may occasionally fail due to issues unrelated to our tests. By implementing this update, we ensure that failures in nightly do not block critical tests for stable versions.

[magajh]

For more context on this solution, see eduNEXT/eox-tenant#232 (comment)

[BryanttV]

Thanks @magajh! This change affects all Tutor versions, right? For example, if v18 integration tests fail, do the other versions still run?

[magajh]

Thanks @magajh! This change affects all Tutor versions, right? For example, if v18 integration tests fail, do the other versions still run?

That's correct @BryanttV. I couldn't find a way to continue the execution for the other tutor_versions in the matrix only if 'nightly' fails. The use of continue-on-error marks the workflow for nightly as passed even if something fails during the execution

[BryanttV]

@magajh, Could you try this? I don't know if it works

jobs:
  integration-test:
    name: Tutor Integration Tests
    runs-on: ubuntu-latest
    continue-on-error: ${{ matrix.experimental }}
    strategy:
      fail-fast: false
      matrix:
        tutor_version: ['<18.0.0', '<19.0.0']
        experimental: [false]
        include:
          - version: 'nightly'
            experimental: true

I was guided by this docs. However, if it doesn't work or we don't want to complicate things, it seems to me that the current solution is a good one.

[magajh]

@magajh, Could you try this? I don't know if it works

jobs:
  integration-test:
    name: Tutor Integration Tests
    runs-on: ubuntu-latest
    continue-on-error: ${{ matrix.experimental }}
    strategy:
      fail-fast: false
      matrix:
        tutor_version: ['<18.0.0', '<19.0.0']
        experimental: [false]
        include:
          - version: 'nightly'
            experimental: true

I was guided by this docs. However, if it doesn't work or we don't want to complicate things, it seems to me that the current solution is a good one.

@BryanttV Thanks for the suggestion! Since we’re only applying continue-on-error for the nightly version, I think we don’t need to introduce the additional experimental field in the matrix. That field could be useful for handling things dynamically across multiple versions, but in this case, looks like it adds unnecessary complexity.

Using continue-on-error: ${{ matrix.tutor_version == 'nightly' }} should be a simpler and more direct way to achieve the same result.

That said, one limitation of continue-on-error is that it marks the nightly tests as passed even if they fail, as it happened with the last commit dc479c7

[magajh]

@mariajgrimaldi @BryanttV @jignaciopm this is ready for the final review

[BryanttV]

LGTM! Thanks @magajh