Skip to content

Quantize: specify each major tensor quant in CLI for common LLMs#8917

Draft
Nexesenex wants to merge 10 commits intoggerganov:masterfrom Nexesenex:lcpp_pr_specific_quants
+146-12

Commits