Skip to content

Commit

Permalink
fix: llama_grammar_accept_token arg order (#1649)
Browse files Browse the repository at this point in the history
Old was:
llama_grammar_accept_token(ctx, grammar, token)

Now this is:
llama_grammar_accept_token(grammar, ctx, token)
  • Loading branch information
tc-wolf authored Aug 4, 2024
1 parent f7b9e6d commit 5575fed
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llama_cpp/_internals.py
Original file line number Diff line number Diff line change
Expand Up @@ -511,7 +511,7 @@ def sample_token(self, candidates: "_LlamaTokenDataArray") -> int:
def grammar_accept_token(self, grammar: LlamaGrammar, token: int):
assert self.ctx is not None
assert grammar.grammar is not None
llama_cpp.llama_grammar_accept_token(self.ctx, grammar.grammar, token)
llama_cpp.llama_grammar_accept_token(grammar.grammar, self.ctx, token)

def reset_timings(self):
assert self.ctx is not None
Expand Down

0 comments on commit 5575fed

Please sign in to comment.