Skip to content

gguf-split: split and merge gguf per batch of tensors#6135

Merged
phymbert merged 5 commits intoggerganov:masterfrom phymbert:hp/feature/gguf-splitMar 19, 2024