Skip to content

b3841

Compare
Choose a tag to compare
@github-actions github-actions released this 29 Sep 14:21
faac0ba
common : ensure llama_batch size does not exceed max size (#9668)

A crash was observed when the number of tokens added to a batch exceeds
llama_batch size. An assertion in llama_batch_add was added to protect
against llama_batch size overflow.