Skip to content

Add --load-in-4bit and --load-in-8bit for HF eval backend #1171

Add --load-in-4bit and --load-in-8bit for HF eval backend

Add --load-in-4bit and --load-in-8bit for HF eval backend #1171