Skip to content

Commit

Permalink
Updating README with vLLM support
Browse files Browse the repository at this point in the history
  • Loading branch information
noamgat committed Oct 18, 2023
1 parent ee99beb commit b7b88eb
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ print(result)

## Capabilities / Advantages

- Works with any Python language model and tokenizer. Already supports transformers and LangChain. Can be adapted to others.
- Works with any Python language model and tokenizer. Already supports transformers, [LangChain](https://docs.langchain.com/docs/) and [vLLM](https://github.com/vllm-project/vllm). Can be adapted to others.
- Supports batched generation and beam searches - each input / beam can have different tokens filtered at every timestep
- Supports both JSON Schema and Regular Expression formats
- Supports both required and optional fields in JSON schemas
Expand Down

0 comments on commit b7b88eb

Please sign in to comment.