Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
codelion authored Oct 24, 2024
1 parent 407e967 commit 6d4d367
Showing 1 changed file with 12 additions and 0 deletions.
12 changes: 12 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,18 @@ optillm is an OpenAI API compatible optimizing inference proxy which implements

## Installation

### Using pip

```bash
pip install optillm
optillm
2024-10-22 07:45:05,612 - INFO - Loaded plugin: privacy
2024-10-22 07:45:06,293 - INFO - Loaded plugin: memory
2024-10-22 07:45:06,293 - INFO - Starting server with approach: auto
```

### Install from source

Clone the repository with `git` and use `pip install` to setup the dependencies.

```bash
Expand Down

0 comments on commit 6d4d367

Please sign in to comment.