Skip to content

Allow GPTQModel to auto select Marlin or faster kernels for inference… #1080

Allow GPTQModel to auto select Marlin or faster kernels for inference…

Allow GPTQModel to auto select Marlin or faster kernels for inference… #1080