ikawrakow ik_llama.cpp Ideas · Discussions · GitHub

New quantization types IQ2_K, IQ3_K, IQ4_K, IQ5_K
Show and tell ikawrakow

Sort by: Latest activity

Categories

Community guidelines

Ideas Discussions

Share ideas for new features

You must be logged in to vote

Convenience improvements for llama-quantize

Nexesenex started Oct 23, 2024 in Ideas

0
You must be logged in to vote

New argument / env variable for GGML_SCHED_MAX_COPIES?

Nexesenex started Oct 21, 2024 in Ideas

2
You must be logged in to vote

4bpw GGML TYPE?

Nexesenex started Oct 7, 2024 in Ideas

6