Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/comparison matrix #1

Merged
merged 2 commits into from
Oct 17, 2023
Merged

Feature/comparison matrix #1

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
fafc7a4
Added comparison matrix to README
noamgat Oct 17, 2023
bed4aec
Comparison matrix fixes
noamgat Oct 17, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 15 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -58,6 +58,21 @@ print(result)
- Gives the language model freedom to control whitespacing and field ordering in JSON schemas, reducing hallucinations.
- Does not modify the high level loop of transformers API, so can be used in any scenario.


## Comparison to other libraries

Capability | LM Format Enforcer | [Guidance](https://github.com/guidance-ai/guidance) | [Jsonformer](https://github.com/1rgs/jsonformer) | [Outlines](https://github.com/outlines-dev/outlines)
:------------ | :-------------| :-------------| :------------- | :----
Regular Expressions | :white_check_mark: | :white_check_mark: | :x: | :white_check_mark:
JSON Schema | :white_check_mark: | :yellow_circle: (Partial support via Handlebars) | :white_check_mark: | :white_check_mark:
Batched Generation | :white_check_mark: | :x: | :x: | :x:
Beam Search | :white_check_mark: | :x: | :x: | :x:
Transformers pipelines | :white_check_mark: | :x: | :x: | :x:
Optional JSON Fields | :white_check_mark: | :x: | :x: | :x:
LLM Controls JSON field ordering and whitespace | :white_check_mark: | :x: | :x: | :x:

Spotted a mistake? Library updated with new capabilities? [Open an issue!](https://github.com/noamgat/lm-format-enforcer/issues)

## Detailed example

We created a Google Colab Notebook which contains a full example of how to use this library to enforce the output format of llama2, including interpreting the intermediate results. The notebook can run on a free GPU-backed runtime in Colab.
Expand Down
Loading