Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] github models过了,能不能用那里的token访问? #5336

Closed
liuruidong4 opened this issue Aug 30, 2024 · 10 comments
Closed
Labels
enhancement New feature or request

Comments

@liuruidong4
Copy link

🥰 Feature Description

不知道应该如何设置,根据github modles文档可以使用。

🧐 Proposed Solution

不知道应该如何设置,根据github modles文档可以使用。

📝 Additional Information

No response

@liuruidong4 liuruidong4 added the enhancement New feature or request label Aug 30, 2024
@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Title: [Feature Request] If github models have been passed, can I use the token there to access them?

🥰 Feature Description

I don’t know how to set it up, but it can be used according to the github modles documentation.

🧐 Proposed Solution

I don’t know how to set it up, but it can be used according to the github modles documentation.

📝 Additional Information

No response

@QAbot-zh
Copy link

自定义接口地址填:https://models.inference.ai.azure.com/chat/completions?
密钥填 github 生成的 token

@kiklata
Copy link

kiklata commented Sep 2, 2024

自定义接口地址填:https://models.inference.ai.azure.com/chat/completions? 密钥填 github 生成的 token

似乎没有成功,提示No authorization header found in request

@QAbot-zh
Copy link

QAbot-zh commented Sep 3, 2024

自定义接口地址填:https://models.inference.ai.azure.com/chat/completions? 密钥填 github 生成的 token

似乎没有成功,提示No authorization header found in request

之前写错了,填这个:https://models.inference.ai.azure.com/chat/completions#,实测有效

@liuruidong4
Copy link
Author

自定义接口地址填:https://models.inference.ai.azure.com/chat/completions? 密钥填 github 生成的 token

似乎没有成功,提示No authorization header found in request

之前写错了,填这个:https://models.inference.ai.azure.com/chat/completions#,实测有效

是的,可以了谢谢~

@ShiinaKin
Copy link

自定义接口地址填:https://models.inference.ai.azure.com/chat/completions? 密钥填 github 生成的 token

似乎没有成功,提示No authorization header found in request

之前写错了,填这个:https://models.inference.ai.azure.com/chat/completions#,实测有效

@QAbot-zh 很抱歉打扰你,但是想请问一下,是在设置的自定义接口下,自定义Azure的接口地址为https://models.inference.ai.azure.com/chat/completions#,接口密钥为GithubPAT,并自定义模型名为Phi-3-medium-128k-instruct之类的GitHub Models提供的模型吗

我这样设置后返回:

{
  "error": {
    "message": "The model `Phi-3-medium-128k-instruct` does not exist or you do not have access to it.",
    "type": "invalid_request_error",
    "param": null,
    "code": "model_not_found"
  }
}

@QAbot-zh
Copy link

QAbot-zh commented Sep 3, 2024

github Models 的模型都走 openai 格式,选择 openai 类型填就好了

image

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


The models in github Models are all in openai format, just select the openai type and fill it in.

image

@ShiinaKin
Copy link

github Models 的模型都走 openai 格式,选择 openai 类型填就好了

image

这样似乎会覆盖原有的openai设置,看来要等本项目加入对Github Model的支持了

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


All models in github Models are in openai format, just select the openai type and fill it in

![image](https://private-user-images.githubusercontent.com/40236765/363831708-bdb564fe-9dce-40c5-8739-652b1a5de227.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiO iJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjUzMzQ0ODgsIm5iZiI6MTcyNTMzNDE4OCwicGF0aCI6Ii80MDIzNjc2NS8 zNjM4MzE3MDgtYmRiNTY0ZmUtOWRjZS00MGM1LTg3MzktNjUyYjFhNWRlMjI3LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQ TUzUFFLNFpBJTJGMjAyNDA5MDMlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTAzVDAzMjk0OFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlP TIyNDgxMWJmZjE3YzM0ODVlMDBjYTg0YzdjZDQyYWVlZjkwMTBmZjBmODMzOGM5YjUxODY2ZWIwODljNGEzZWQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2 lkPTAmcmVwb19pZD0wIn0.T7_W3CNVqTIaMqjLPoyAaiQe5wf1mvJGhmzhCV1G5WE)

This seems to overwrite the original openai settings. It seems that we have to wait until this project adds support for Github Model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

5 participants