You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
OpenRouter spec does not perfectly conform to OpenAI so it has it's own ruby gem. But what's great about OpenRouter is that it supports TONS of models and seems to be a much more reliable, long-term way of running Llama 3, among other LLMs. Groq isn't so good if someone actually wants to use Llama 3 long term.
Obie started this task but didn't finish. He's the author of the OpenRouter gem so we can ask him questions if we have any:
OpenRouter spec does not perfectly conform to OpenAI so it has it's own ruby gem. But what's great about OpenRouter is that it supports TONS of models and seems to be a much more reliable, long-term way of running Llama 3, among other LLMs. Groq isn't so good if someone actually wants to use Llama 3 long term.
Obie started this task but didn't finish. He's the author of the OpenRouter gem so we can ask him questions if we have any:
obie@250467d
This is the API docs I found:
https://openrouter.ai/docs/requests
Additional considerations for full OSS LLM support:
#389 (comment)
The text was updated successfully, but these errors were encountered: