Skip to content

Commit

Permalink
server : fix typo in comment
Browse files Browse the repository at this point in the history
  • Loading branch information
compilade committed Aug 14, 2024
1 parent af2f84c commit 93ec58b
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/server/server.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -754,7 +754,7 @@ struct server_context {
default_generation_settings_for_props = get_formated_generation(slots.front());
default_generation_settings_for_props["seed"] = -1;

// the update_slots() logic will always submit a maximum of n_batch or n_parralel tokens
// the update_slots() logic will always submit a maximum of n_batch or n_parallel tokens
// note that n_batch can be > n_ctx (e.g. for non-causal attention models such as BERT where the KV cache is not used)
{
const int32_t n_batch = llama_n_batch(ctx);
Expand Down

0 comments on commit 93ec58b

Please sign in to comment.