Skip to content

Latest commit

 

History

History
17 lines (14 loc) · 413 Bytes

README.md

File metadata and controls

17 lines (14 loc) · 413 Bytes

projection

Command

  1. simpily run
    python moe_projection.py
  2. use projection.ipynb

Example

Mixtral-8x7B

Mixtral-8x7B Projection Mixtral-8x7B_projection_table

Notes

  1. Currently only with single card, will support multi-card / multi-node.
  2. Only cover Mixtral-8x7B, will cover more.