Skip to content

b3798

Compare
Choose a tag to compare
@github-actions github-actions released this 21 Sep 02:04
41f4778
Update CUDA graph on scale change plus clear nodes/params  (#9550)

* Avoid using saved CUDA graph if scale changes and reset nodes/params on update

Fixes https://github.com/ggerganov/llama.cpp/issues/9451

* clear before resize