Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEAT]: Improve UX to let user know which LLM is actually going to be used #2642

Open
kcalliauw opened this issue Nov 18, 2024 · 0 comments
Open
Labels
enhancement New feature or request feature request

Comments

@kcalliauw
Copy link

What would you like to see?

As a user I tend to like to switch between LLMs often (this includes switching between Ollama models and OpenAI + Anthropic external models), and I currently find it very confusing / impossible to predict which of my LLMs are going to be chosen for a thread.

  • LLM can be set in the Instance settings
  • LLM can be set in the workspace settings
  • LLM can be set in the workspace settings (but specific for agents)

As far as I can tell, if I change the chat agent in my workspace, the existing threads remain unaffected, which "feels" like a bug to me. I would expect (where possible) context to be carried over to the newly chosen LLM.

Ideally, like in various apps: ChatGPT or TypingMind, the LLM can be chosen inside the chat context/thread. For example, here are a few UX experiences I find to be very beneficial:

CleanShot 2024-11-18 at 09 35 41

CleanShot 2024-11-18 at 09 36 44

Just my 2 cents. Keep up the great work!

@kcalliauw kcalliauw added enhancement New feature or request feature request labels Nov 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request feature request
Projects
None yet
Development

No branches or pull requests

1 participant