LLMForwarder is a Python package for forwarding chat requests to OpenAI-compatible API endpoints. It allows users to customize request handling through an external function. This package is ideal for injecting custom context or pre-processing user messages before forwarding to the model API.
- Configurable server address and port
- Flexible OpenAI API integration
- Customizable prompt-handling function, allowing easy injection of context or prompt modifications
- Easy setup and usage for OpenAI-compatible models
To install LLMForwarder, use pip:
pip install llm-forwarder