ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels (#9217) · gabe-l-hart/llama.cpp@1e43630 · GitHub

Commit

ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels (ggerganov#…

Browse files

…9217)

* ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels

* added fallback mechanism when the offline re-quantized model is not
optimized for the underlying target.

* fix for build errors

* remove prints from the low-level code

* Rebase to the latest upstream

Loading branch information

chaxu01 authored Sep 25, 2024

1 parent afbbfaa commit 1e43630