Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
llama : use reserve/emplace_back in sampler_sample (ggml-org#9534)
This commit updates the llama_sampler_sample function to use reserve and emplace_back for the vector of llama_token_data structs. The motivation for this change is to avoid the creation of n_vocab default-constructed llama_token_data structs which are then immediately overwritten.
- Loading branch information