Skip to content

Commit

Permalink
align commits and fix syntax json fetching
Browse files Browse the repository at this point in the history
  • Loading branch information
[email protected] committed Dec 17, 2024
1 parent cc46c93 commit 3df7f71
Showing 1 changed file with 10 additions and 2 deletions.
12 changes: 10 additions & 2 deletions docs/04_Model Serving/API Reference.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,8 @@ tags:
---
import Tabs from '@theme/Tabs';
import TabItem from '@theme/TabItem';
import FetchJson from '@site/src/components/FetchJson';


## Introduction
T-System LLM Serving have an API Interface compatible with OpenAI's Chat, Completion, Vision and Embedding API.
Expand Down Expand Up @@ -49,11 +51,17 @@ pip install openai
print(model.id)
```
</TabItem>

<TabItem value="json" label="JSON">

<FetchJson url="https://llm-server.llmhub.t-systems.net/v1/chat/completions" method="POST" body={{ key: 'value' }} />

</TabItem>

</Tabs>

:::info
Above code will show all the LLM and Embedding models that available dedicated for your key.
Above code will show all the LLMs and Embedding models that are dedicated to your key.
:::

Example output:
Expand Down Expand Up @@ -284,7 +292,7 @@ llava-v1.6-vicuna-13b
```


**Step 2: Sent question together with the image url**
**Step 2: Send question together with the image url**

<Tabs>
<TabItem value="py" label="Python" default>
Expand Down

0 comments on commit 3df7f71

Please sign in to comment.