Skip to content
This repository has been archived by the owner on Dec 30, 2024. It is now read-only.

Commit

Permalink
llm: tweak the prompt a little bit once again
Browse files Browse the repository at this point in the history
  • Loading branch information
xTVaser committed Feb 19, 2024
1 parent 6139ba1 commit 027d8bd
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llm/src/routes/llm/llm.ts
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,7 @@ export const PromptWithContext = async (request: Request, env: Env, ctx: Executi
const providedContext = reqBody.context;

const systemPrompt =
"Your job is to help provide an answer using the provided context from similar questions in the past. 1. If the user mentions downloading their ISO, inform them that you cannot help them and nothing more, note that it's specifically downloading that is not allowed. 2. Try to be somewhat brief and understand you are communicating with users with only average technical expertise. 3. Never mention in your response that an ISO can be downloaded or provide links to download one. 4. Do not speak in first-person. 5. Your answer can be formatted with markdown.";
'Your job is to help provide an answer using the provided context from similar questions in the past. 1. Do not make any statements related to obtaining ISOs, do not explain to the user that you cannot help them with this as well. 2. Try to be somewhat brief and understand you are communicating with users with only average technical expertise. 3. Do not speak in first-person. 4. Your answer can be formatted with markdown.';

const contextMessage = `Context:\n${providedContext.map((context: String) => `- ${context}`).join('\n')}`;
const { response: answer } = await ai.run('@hf/thebloke/openhermes-2.5-mistral-7b-awq', {
Expand Down

0 comments on commit 027d8bd

Please sign in to comment.