Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Model server with Geneformer pilot: tokenizer #323

Merged
merged 8 commits into from
Oct 20, 2024
Merged
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
mend
amva13 committed Oct 20, 2024
commit e03614be8c3eb60d1716ed643f98231bfacbd701
2 changes: 1 addition & 1 deletion .circleci/config.yml
Original file line number Diff line number Diff line change
@@ -55,7 +55,7 @@ jobs:
no_output_timeout: 30m
command: |
. venv/bin/activate
pytest --ignore=tdc/test/dev_tests/ --ignore=tdc/test/test_resources.py --ignore=tdc/test/test_dataloaders.py
pytest --ignore=tdc/test/dev_tests/ --ignore=tdc/test/test_resources.py --ignore=tdc/test/test_dataloaders.py --ignore=tdc/test/test_model_server.py

- store_artifacts:
path: test-reports
2 changes: 1 addition & 1 deletion tdc/model_server/tokenizers/geneformer.py
Original file line number Diff line number Diff line change
@@ -9,7 +9,7 @@ class GeneformerTokenizer(TranscriptomeTokenizer):
"""
Uses Geneformer Utils to parse zero-shot model server requests for tokenizing single-cell gene expression data.

Geneformer tokenizer source code: https://github.com/jkobject/geneformer/blob/main/geneformer/tokenizer.py
Tokenizer source code: https://github.com/amva13/geneformer/blob/main/geneformer/tokenizer.py
"""

def __init__(