2-litserve-batching-gpu

Things to note

• torch is required

How to call it

Positive sentiment

curl --location 'https://api.cortex.cerebrium.ai/v4/<your-project-id>/<your-app-name>/predict' \
--header 'Authorization: Bearer <your-api-key>' \
--header 'Content-Type: application/json' \
--data '{"text": "this product is great"}'

Negative sentiment

curl --location 'https://api.cortex.cerebrium.ai/v4/<your-project-id>/<your-app-name>/predict' \
--header 'Authorization: Bearer <your-api-key>' \
--header 'Content-Type: application/json' \
--data '{"text": "this thing is the worst"}'