status/support for grammar sampling

[devidw]

hey

awesome work on hermes 2 pro

getting very good and reliable output for my tool definitions

wondering if this repo has support for grammar sampling?

i am currently using my own inference abstraction for the function calling prompt syntax and parsing and not this repo - and i did notice that in a small number of cases, it makes argument values up, that do not exist in my definition

which grammar sampling should fix

is it part of this repo? if not, planned to add it?

reference MeetKai/functionary#74