在 MacOS 上，http自定义 API 仅支持 localhost，使用非本机 ip 或 url 均无法访问[Bug]

[wjfu99]

Bug Description

自定义接口使用本地部署的 API可以正常使用，使用非本机部署的API 显示 failed to load 或 failed to fetch。部署的 API 应该没有问题，在本机通过端口转发将外部 ip 对应端口映射至本地也可正常使用。

Steps to Reproduce

1.使用本地部署 api：

2.使用非本机部署 api：

Expected Behavior

使用 http+外部 ip 的 API 也可以正常使用。

Screenshots

No response

Deployment Method

• Docker
• Vercel
• Server

Desktop OS

Macos

Desktop Browser

No response

Desktop Browser Version

No response

Smartphone Device

No response

Smartphone OS

No response

Smartphone Browser

No response

Smartphone Browser Version

No response

Additional Logs

No response

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Title: http custom API only supports localhost, and cannot be accessed using non-native IP or url [Bug]

[fred-bf]

from you screenshot it seems to the cors issue with your openai api provider?

[wjfu99]

from you screenshot it seems to the cors issue with your openai api provider?

but if i forward the api provider ip&port to local, then the nextweb works well, it's very strange. By the way, the api provider is deployed in a server on the same subnet, and i currently use vscode for prot forwarding.😂

[wjfu99]

sorry, close the issue by accident.

[wjfu99]

from you screenshot it seems to the cors issue with your openai api provider?

Besides, I can access the API service well via curl command:

curl --location 'http://ip:port/v1/chat/completions' \
--header 'Content-Type: application/json' \
--header 'Authorization: xxxxx' \
--data '{
  "model": "gpt-4",
  "messages": [ {"role": "user", "content": "hello"}]
}'

the api service also works with a congeneric app ChatX, but in NextChat, it still not work.

[wjfu99]

I have used Burp Suite to capture http package, and the result demonstrate that when using a API deployed in localhost, the request packages are sent correctly:

OPTIONS /v1/chat/completions HTTP/1.1
Host: localhost:1999
Accept: */*
Access-Control-Request-Method: POST
Access-Control-Request-Headers: content-type,x-requested-with
Origin: https://app.nextchat.dev
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.6167.160 Safari/537.36
Sec-Fetch-Mode: cors
Sec-Fetch-Site: cross-site
Sec-Fetch-Dest: empty
Accept-Encoding: gzip, deflate, br
Accept-Language: en-US,en;q=0.9
Connection: close

POST /v1/chat/completions HTTP/1.1
Host: localhost:1999
Content-Length: 773
sec-ch-ua: "Chromium";v="121", "Not A(Brand";v="99"
Accept: application/json, text/event-stream
Content-Type: application/json
x-requested-with: XMLHttpRequest
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.6167.160 Safari/537.36
sec-ch-ua-platform: "macOS"
Origin: https://app.nextchat.dev
Sec-Fetch-Site: cross-site
Sec-Fetch-Mode: cors
Sec-Fetch-Dest: empty
Accept-Encoding: gzip, deflate, br
Accept-Language: en-US,en;q=0.9
Connection: close

{"messages":[{"role":"system","content":"\nYou are ChatGPT, a large language model trained by OpenAI.\nKnowledge cutoff: 2021-09\nCurrent model: gpt-4\nCurrent time: 2/22/2024, 9:31:13 AM\nLatex inline: $x^2$ \nLatex block: $$e=mc^2$$\n\n"},{"role":"user","content":"hello"},{"role":"assistant","content":"Hello! How can I assist you today?"},{"role":"user","content":"0.0.0.0 是监听本机所有 ip 吗"},{"role":"assistant","content":"\n\nUnauthorized access, please enter access code in [auth](/#/auth) page, or enter your OpenAI API Key.\n\n```json\n{\n  \"error\": \"Unauthorized\"\n}\n```"},{"role":"user","content":"docker -e 可以添加多个环境变量吗"}],"stream":true,"model":"gpt-4","temperature":0.5,"presence_penalty":0,"frequency_penalty":0,"top_p":1}

And if I set the endpoint API to another subnet host (Like http://222.21.136.207:1999), then no http package is captured, and the NextChat just raise an error:

However, if I set the API to localhost back, then capture and redirect the http package to the subnet host. In this way, NextChat can receive the response package from the subnet host and works correctly, which can not achieved by directly set the subnet host API as the endpoint API in the configuration.

[SubtleSpark]

你是不是使用了 NAT 进行了端口映射，这可能会有 NAT 环回的问题。

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Have you used NAT for port mapping? This may cause NAT loopback problems.

[wjfu99]

你是不是使用了 NAT 进行了端口映射，这可能会有 NAT 环回的问题。

我应该没有主动配置 NAT 端口映射，而且 NAT 环回会导致 NextChat这类 app不能 send url request 吗？主要用 curl又是好的，就很奇怪。

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Have you used NAT for port mapping? This may cause NAT loopback problems.
I should not have actively configured NAT port mapping, and will NAT loopback prevent apps like NextChat from sending url requests? Mainly using curl is fine, but it's strange.

[WAGMY]

Same problem, Macos + Docker, Set api to localhost works fine, but it won't work if set to my own server ip, but I can access the api service well via python script.

[WAGMY]

Same problem, Macos + Docker, Set api to localhost works fine, but it won't work if set to my own server ip, but I can access the api service well via python script.

Supplement: If using windows nextchat client, it work fine if set to my own server ip

[wjfu99]

Same problem, Macos + Docker, Set api to localhost works fine, but it won't work if set to my own server ip, but I can access the api service well via python script.

Supplement: If using windows nextchat client, it work fine if set to my own server ip

Very useful information, i'm a mac user too, and the nextchat web also didn't work on ios device. i will test it on windows later.

[daobee]

Same problem.
I hosted a OpenAI-Like API on server and it works fine with curl(on macos)/Next-Web(on windows client),but raised a error using Next-Web(on macos client)

curl(on macos):

Next-Web(on windows client):
Just works fine.
Next-Web(on macos client):

[wjfu99]

@fred-bf I believe the bug tag should be added back, since another issue #2810 reveals this bug too. This bug seems to exist for a period.

[H0llyW00dzZ]

I don't have any issues with this; it has been running on Kubernetes (k8s) without problems

[wjfu99]

I don't have any issues with this; it has been running on Kubernetes (k8s) without problems

Are you using an Mac client? It seems that the issue only exist on Mac.

[H0llyW00dzZ]

I don't have any issues with this; it has been running on Kubernetes (k8s) without problems

Are you using an Mac client? It seems that the issue only exist on Mac.

right now I am using windows client and using port-forward pods k8s

[LimLLL]

kind reminder, ur api domain exposed in ur first image

[fred-bf]

I just tried build a development macOS client, it could make request to custom ip. But when switching to a online version, I could reproduce this issue. It might be released to tauri production build configuration?

[H0llyW00dzZ]

I just tried build a development macOS client, it could make request to custom ip. But when switching to a online version, I could reproduce this issue. It might be released to tauri production build configuration?

no,the problem its not only desktop

[wjfu99]

I just tried build a development macOS client, it could make request to custom ip. But when switching to a online version, I could reproduce this issue. It might be released to tauri production build configuration?

Supplement: the same problem also occurs on the online web version (app.nextchat.dev) and the self-deployed vercel version. Hope this info help.

[fred-bf]

@wjfu99 For web version, plz check whether its blocked by mixed https content

[wjfu99]

@fred-bf Hi, you are absolutely right! i check the console log, and find the mixed content error:

So, this issue on web version can be solved by allowing the insecure content in website permission:

By the way, do you have any ideas on how to solve this problem in the local client version?🤣

@wjfu99 For web version, plz check whether its blocked by mixed https content

[fred-bf]

close for now, please feel free to report if you encounter any additional issue

[hhhaiai]

how fix

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

how fix

[hhhaiai]

how can i do, how fix

机器人检测到问题主体的语言不是英语，请自动翻译。

如何修复

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

how can i do, how to fix

The robot has detected that the language of the subject of the question is not English, please automatically translate it.

How to fix 

[wjfu99]

@hhhaiai you can solve this by allowing the insecure content in website permission (chrome and edge should both support that): refer to this reply

[chengs]

为什么要发送OPTIONS给API？直接发POST不行么

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Why send OPTIONS to API? Can't you just send a POST directly?