Postprocess in clean_tool_call instead

pepperoni21 · Nov 19, 2024 · c1c209d · c1c209d
1 parent ef17ca7
commit c1c209d
Show file tree

Hide file tree

Showing 2 changed files with 2 additions and 1 deletion.
diff --git a/src/generation/functions/pipelines/meta_llama/prompts.rs b/src/generation/functions/pipelines/meta_llama/prompts.rs
@@ -3,7 +3,7 @@ You have access to the following functions:
 {tools}
 If you choose to call a function ONLY reply in the following format with no prefix or suffix:
 
-<function=example_function_name>{{"example_name": "example_value"}}</function>
+<function=example_function_name>{{\"example_name\": \"example_value\"}}</function>
 
 Reminder:
 - Function calls MUST follow the specified format, start with <function= and end with </function>

diff --git a/src/generation/functions/pipelines/meta_llama/request.rs b/src/generation/functions/pipelines/meta_llama/request.rs
@@ -60,6 +60,7 @@ impl LlamaFunctionCall {
             .to_string()
             .replace("{{", "{")
             .replace("}}", "}")
+            .replace("\\\"", "\"")
     }
 
     fn parse_tool_response(&self, response: &str) -> Vec<LlamaFunctionCallSignature> {