From b7b88ebcfb6528ad4dfdb2d8743e4832e56ea6e6 Mon Sep 17 00:00:00 2001 From: Noam Gat Date: Wed, 18 Oct 2023 21:13:55 +0300 Subject: [PATCH] Updating README with vLLM support --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index af9dc32..6315a28 100644 --- a/README.md +++ b/README.md @@ -50,7 +50,7 @@ print(result) ## Capabilities / Advantages -- Works with any Python language model and tokenizer. Already supports transformers and LangChain. Can be adapted to others. +- Works with any Python language model and tokenizer. Already supports transformers, [LangChain](https://docs.langchain.com/docs/) and [vLLM](https://github.com/vllm-project/vllm). Can be adapted to others. - Supports batched generation and beam searches - each input / beam can have different tokens filtered at every timestep - Supports both JSON Schema and Regular Expression formats - Supports both required and optional fields in JSON schemas