Sdxl Q8 gguf

[ReyJ94]

I use a lot sdxl for inpainting and upscaling. I wanted to convert my custom sdxl model to Q8 gguf. There is a very slight drop from fp16. I searched for a guide but could not find one. Can you help ?

[rainlizard]

https://github.com/city96/ComfyUI-GGUF/tree/main/tools

That's the main guide, or you can use my Windows GUI which is easier to use:

https://github.com/rainlizard/EasyQuantizationGUI/releases

[ReyJ94]

Wow, i will for sure use your GUI instead. Thank you for sharing. I had tried coding a quantization script with O1, but this is easier. I hope it's self contained.

[anaseinea]

dude maybe put this GUI tool in the main README cause I went through the tools way and it is a lot of work and couldn't get it to work, thanks a lot !