Add option to execute tests on already built binaries

[dm-vodopyanov]

This patch adds new option --run-only to run_conformance_tests.py to be able to execute tests on already built binaries.

[dm-vodopyanov]

Failure in SYCL CTS CI / compile-cts (dpcpp, 20a088e1231c4ac85fd74c0de79c563977d2f38c) (pull_request) seems unrelated, a problem in CI:

/usr/bin/ld: final link failed: No space left on device
clang++: error: linker command failed with exit code 1 (use -v to see invocation)

[dm-vodopyanov]

@bader can you please merge the PR as ead430a has only non-functional changes? The previous commit passes in pre-commit.

[bader]

@bader can you please merge the PR as ead430a has only non-functional changes? The previous commit passes in pre-commit.

@dm-vodopyanov, no. It's not ready for merge.

[keryell]

Thanks.

[bader]

Failure in SYCL CTS CI / compile-cts (dpcpp, 20a088e1231c4ac85fd74c0de79c563977d2f38c) (pull_request) seems unrelated, a problem in CI:

/usr/bin/ld: final link failed: No space left on device
clang++: error: linker command failed with exit code 1 (use -v to see invocation)

This issue appears twice in this PR and that worries me. @steffenlarsen, do you think recent changes might cause this?

[steffenlarsen]

This issue appears twice in this PR and that worries me. @steffenlarsen, do you think recent changes might cause this?

It definitely doesn't look related to the changes proposed here. I suppose any addition of tests increases the memory consumption of test_all. I am on the cusp of saying we should just drop test_all or not build it in CI. It is somewhat redundant, though slightly different, as it is an executable combining all the categories. Personally, I think it should build test_conformance instead, which is test_all without the mastodon of an executable that is test_all.

[bader]

This issue appears twice in this PR and that worries me. @steffenlarsen, do you think recent changes might cause this?

It definitely doesn't look related to the changes proposed here. I suppose any addition of tests increases the memory consumption of test_all. I am on the cusp of saying we should just drop test_all or not build it in CI. It is somewhat redundant, though slightly different, as it is an executable combining all the categories. Personally, I think it should build test_conformance instead, which is test_all without the mastodon of an executable that is test_all.

Okay. I'm merging this PR and will watch CI results. If this issue impacts CI results, we will need to figure something out.

[bader]

Failure in SYCL CTS CI / compile-cts (dpcpp, 20a088e1231c4ac85fd74c0de79c563977d2f38c) (pull_request) seems unrelated, a problem in CI:

/usr/bin/ld: final link failed: No space left on device
clang++: error: linker command failed with exit code 1 (use -v to see invocation)

@steffenlarsen, I think we need address this issue ASAP. Now we have four consecutive failures due to this issue: 3 runs before the merge and one run after the merge.