ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels (#9217) · arthw/llama.cpp@f4ba90f · GitHub

Commit

ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels (ggml-org#9217

Browse files

)

* ggml : remove assert for AArch64 GEMV and GEMM Q4 kernels

* added fallback mechanism when the offline re-quantized model is not
optimized for the underlying target.

* fix for build errors

* remove prints from the low-level code

* Rebase to the latest upstream

Loading branch information

chaxu01 authored and arthw committed Nov 15, 2024

1 parent a2500e5 commit f4ba90f