Vit triton (fp + quant / tp + dp), custom image pre_process#663

Open

shihaobai wants to merge 10 commits intomainfrom vit_quant

+1,194-49

Commits on Dec 9, 2024

vit triton (draft)
baishihao
committed

Commits on Dec 10, 2024

vit quant (pre)
baishihao
committed

Commits on Dec 11, 2024

vit 6b tp
baishihao
committed
custom pre_process
baishihao
committed
vit quant & quant for dp + tp
baishihao
committed
merge main
baishihao
committed
add quant use_custom_alloc
baishihao
committed
fix precision(ongoing)
baishihao
committed
fix vit6b precision
baishihao
committed
add statc speed script for vit
baishihao
committed