Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JUnit Test Report job does not appear in the workflow run #1234

Closed
liyaka opened this issue Nov 11, 2024 · 9 comments
Closed

JUnit Test Report job does not appear in the workflow run #1234

liyaka opened this issue Nov 11, 2024 · 9 comments

Comments

@liyaka
Copy link

liyaka commented Nov 11, 2024

Hi, we have a strange behavior that started lately - when there are failed tests, JUnit Test Report job does not appear in the workflow run:
Screenshot 2024-11-11 at 18 32 58

We do get the summary, but no not job where we can see the details and the logs
Screenshot 2024-11-11 at 18 33 17

The way we expect it to work is this (it used to work like this, nothing is changed in our configuration):
Screenshot 2024-11-11 at 18 19 59

the configuration is simple:

- name: Publish Test Report
          uses: mikepenz/action-junit-report@v4
          if: success() || failure() # always run even if the previous step fails
          with:
            report_paths: 'report.xml'
            fail_on_failure: true
            summary: true
            detailed_summary: true
@mikepenz
Copy link
Owner

Good day.

This is a strange one. Does it maybe get added to a different check?
Nothing indicates that there was a change in the action, as the respective API is still called here: https://github.com/mikepenz/action-junit-report/blob/v4.3.1/src/annotator.ts#L99-L100

Could be some behavior change from GitHub's side 🤔

@liyaka
Copy link
Author

liyaka commented Nov 12, 2024

I also tried to upgrade to v5, same result :(
What do you mean by "Does it maybe get added to a different check?" ?
Any suggestions? additional configuration?...

@mikepenz
Copy link
Owner

v5 only contains improvement to test suite handling and to the formatting of the summary.

For the different check I actually used the wrong wording. There's a long standing GitHub issue where reprots might be sent to the wrong build: #40

So I was wondering if that possibly happens in your case

@mikepenz
Copy link
Owner

Or a different thought (which would be weird that it does not fail doing the API request) - does the CI have all permissions required?

https://github.com/mikepenz/action-junit-report?tab=readme-ov-file#pr-run-permissions

@liyaka
Copy link
Author

liyaka commented Nov 12, 2024

Or a different thought (which would be weird that it does not fail doing the API request) - does the CI have all permissions required?

Since it used to work (until about a week ago) I guess yes...

@liyaka
Copy link
Author

liyaka commented Nov 12, 2024

For the different check I actually used the wrong wording. There's a long standing GitHub issue where reprots might be sent to the wrong build: #40

We also have runs on PR/main and some schedule runs as well, but in our case, the results are not going anywhere :(
I checked all runs for the same commit (usually it's only one), no results, only the summary as I mentioned in the description..

@mikepenz
Copy link
Owner

Running the tests on the action itself does still create the check. I am out of ideas, but the most likely would be permission issue, or something similar.

Screenshot 2024-11-16 at 17 22 53

@liyaka
Copy link
Author

liyaka commented Dec 8, 2024

I found now that the test report indeed appears in the wrong workflow run - we have build-test and another validation workflow that both run for PR, and tests report appears not with the tests, just like explained in this ticket #40
I our case it's a completely different workflow, not different runs of the same one...
Any updates on this one?
I understand there is still no fix, is there any workaround?

@mikepenz
Copy link
Owner

mikepenz commented Dec 8, 2024

As far as I am aware there was no new update related to the issue from the GitHub side. Unless I missed some new API or some update in the meantime.

Closing this as #40 will be the correct place to have further updates.

Thank you for reporting back.

@mikepenz mikepenz closed this as completed Dec 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants