Skip to content

Collection of experiments related to small language models, mostly seq2seq models

Notifications You must be signed in to change notification settings

brianfitzgerald/smolmodels

Repository files navigation

Smolmodels

Collection of experiments related to tuning small language models for specific tasks.

Installation

python3.10 -m venv venv
pip install torch torchaudio torchvision --index-url https://download.pytorch.org/whl/cu121
pip install -r requirements.txt

About

Collection of experiments related to small language models, mostly seq2seq models

Resources

Stars

Watchers

Forks

Packages

No packages published