Bug: Unable to integrate the completion endpoint with Cline [Error: type must be string, but is array]

[ocrumbs]

Contact Details

No response

What happened?

Cline has feature to integrate OpenAI comptible endpoints. So I tried with awesome llamafile. However Cline is giving such an error:

500 Internal Server Error\n[json.exception.type_error.302] type must be string, but is array

I believe this would be game changer if llamafile could work with it. I also believe this issue is from llamafile and not Cline.

Related issue #258

Version

llamafile v0.8.16

What operating system are you seeing the problem on?

Linux

Relevant log output

No response

[ocrumbs]

This issue is not medium severity. Apologies.

[surfirst]

I also encountered this issue when running a llamafile server with '--server' option.