Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

idea: connect to another self hosted model with the same JAN ui #3916

Closed
Steven0706 opened this issue Oct 30, 2024 · 2 comments
Closed

idea: connect to another self hosted model with the same JAN ui #3916

Steven0706 opened this issue Oct 30, 2024 · 2 comments
Labels
category: model support Support new model, or fix broken model type: feature request A new feature

Comments

@Steven0706
Copy link

Problem Statement

I am hosting some model endpoint on one server with good gpu and I want to use it from another laptop/pc, mixed with cloud provider. So I think it will be great if we can easily use the JAN hosted model in another JAN UI with just the ip and port.

Feature Idea

I am hosting some model endpoint on one server with good gpu and I want to use it from another laptop/pc, mixed with cloud provider. So I think it will be great if we can easily use the JAN hosted model in another JAN UI with just the ip and port. I tried use the openai config but the model name cannot be changed easily.

@Steven0706 Steven0706 added the type: feature request A new feature label Oct 30, 2024
@imtuyethan imtuyethan added this to Menlo Nov 3, 2024
@github-project-automation github-project-automation bot moved this to Investigating in Menlo Nov 3, 2024
@imtuyethan imtuyethan added the category: model support Support new model, or fix broken model label Dec 10, 2024
@AmagiDDmxh
Copy link

metoooo

@imtuyethan
Copy link
Contributor

@github-project-automation github-project-automation bot moved this from Investigating to QA in Menlo Jan 20, 2025
@imtuyethan imtuyethan moved this from QA to Completed in Menlo Jan 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: model support Support new model, or fix broken model type: feature request A new feature
Projects
Archived in project
Development

No branches or pull requests

3 participants