Skip to content

b3783

Compare
Choose a tag to compare
@github-actions github-actions released this 18 Sep 12:58
6443ddd
llama : use reserve/emplace_back in sampler_sample (#9534)

This commit updates the llama_sampler_sample function to use reserve and
emplace_back for the vector of llama_token_data structs.

The motivation for this change is to avoid the creation of n_vocab
default-constructed llama_token_data structs which are then
immediately overwritten.