Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Look into and reconsider CTS tests with high fail rate across adapters. #2514

Open
aarongreig opened this issue Jan 2, 2025 · 1 comment
Assignees
Labels
conformance Conformance test suite issues.
Milestone

Comments

@aarongreig
Copy link
Contributor

aarongreig commented Jan 2, 2025

We've got a few CTS tests that only pass on one or two adapters. The behaviour these tests are enforcing isn't being missed upstream in the backends that are failing, which I think is a sign that either: these tests should have some skipping mechanism, we need a spec adjustment, or in the cases where only one adapter passes we could consider making them adapter specific tests.

These are the ones I noticed while working on the device parameterization PR:

@aarongreig aarongreig added the conformance Conformance test suite issues. label Jan 2, 2025
@aarongreig aarongreig added this to the Backlog milestone Jan 2, 2025
@RossBrunton RossBrunton self-assigned this Jan 7, 2025
@aarongreig
Copy link
Contributor Author

add to the list urKernelGetSubGroupInfoFixedSubGroupSizeTest.CompileNumSubGroups which seems to fail on every adapter (maybe this is something that only works with a specific platform? some of the other tests like this one only work on opencl igpu + fpga emulator)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
conformance Conformance test suite issues.
Projects
None yet
Development

No branches or pull requests

2 participants