Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add tags to skip Triton cells for CI/CD #451

Merged
merged 4 commits into from
Oct 25, 2024

Conversation

rishic3
Copy link
Contributor

@rishic3 rishic3 commented Oct 22, 2024

Triton:

After discussing with @YanxuanLiu @eordentlich, we are skipping the Triton portions of the DL notebooks for now, allowing us to run the notebooks in Docker on the pipeline (in conjunction with this PR).

Added "TRITON" cell tags to all Triton-related cells to enable using Jupyter TagPreprocessor to detect and skip Triton cells without modifying any code on the user-end.

Triton cells can be re-enabled when we have either safe Docker-in-Docker execution or we refactor to use PyTriton client (in progress).

Bugs:

Avoiding use of relative paths for datasets to address CI failures in text_classification_tf and feature_columns_tf.

Signed-off-by: Rishi Chandra <[email protected]>
@rishic3 rishic3 marked this pull request as ready for review October 22, 2024 16:45
eordentlich
eordentlich previously approved these changes Oct 22, 2024
Copy link
Collaborator

@eordentlich eordentlich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Good use of tags.

@YanxuanLiu
Copy link
Collaborator

Test passed in my latest test, thanks!

@eordentlich eordentlich merged commit 4a17536 into NVIDIA:branch-24.10 Oct 25, 2024
2 checks passed
@rishic3 rishic3 deleted the triton branch October 25, 2024 20:06
parthosa pushed a commit to parthosa/spark-rapids-examples that referenced this pull request Oct 30, 2024
* Add Triton cell tags

Signed-off-by: Rishi Chandra <[email protected]>

* Avoid relative paths in tf notebooks

* Use pathlib for relative dirs

* Account for tensorflow extraction path bug

---------

Signed-off-by: Rishi Chandra <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants