We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.
You must be logged in to block users.
Contact GitHub support about this user’s behavior. Learn more about reporting abuse.
I’m interested in Deep Learning.
I’m learning Language Models and their applications.
A process to translate fineweb-edu dataset released by huggingface to indian languages using indictrans2 model.
Python
code to run inference on tokenized sentences using indictrans-2
A codebase to split text into sentences and tokenize them in batches for inference using IndicTrans2
Forked from stanford-crfm/levanter
Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax