From d513eb1a1b9bd756ff2706cc89468c57e701a967 Mon Sep 17 00:00:00 2001 From: Josephine Pfeiffer Date: Mon, 18 Dec 2023 12:45:02 +0100 Subject: [PATCH] Update README.md to include OCP instructions --- README.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/README.md b/README.md index b7a3f04..58a8bcd 100644 --- a/README.md +++ b/README.md @@ -163,6 +163,14 @@ kubectl apply -k deploy/kubernetes/. -n llama Expose your service however you would normally do that. +#### Extra steps to run on OpenShift + +When deploying to OpenShift add the privileged scc to the namespace service account + +```bash +oc adm policy add-scc-to-user privileged -z default -n llama +``` + ## OpenAI compatible API Thanks to llama-cpp-python, a drop-in replacement for OpenAI API is available at `http://localhost:3001`. Open http://localhost:3001/docs to see the API documentation.