Support Models
Research Projects
moe-recipes is used for Swallow Project's Swallow-MX development.
Swallow-MX(model): https://huggingface.co/tokyotech-llm/Swallow-MX-8x7b-NVE-v0.1
Japanese Blog Post: https://zenn.dev/tokyotech_lm/articles/5f4211b9ed3197