ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels (#9217) · dsx1986/llama.cpp@e5673b6 · GitHub

Commit

ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels (ggerganov#…

Browse files

…9217)

* ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels

* added fallback mechanism when the offline re-quantized model is not
optimized for the underlying target.

* fix for build errors

* remove prints from the low-level code

* Rebase to the latest upstream

Loading branch information

chaxu01 authored and dsx1986 committed Oct 29, 2024

1 parent 5a49d62 commit e5673b6