generated from songquanpeng/gin-template
-
-
Notifications
You must be signed in to change notification settings - Fork 4.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ollama部署qwen2:7b api调用报错 #1646
Labels
bug
Something isn't working
Comments
降低版本到0.6.6或以下版本可以解决。 |
确实是的,降级就好了,这个问题太。。。。 |
前几天退到0.67版本可以正常调用。这个问题有点奇葩了 |
已解决,渠道类型不用 ollama,而是选择 自定义 类型即可避免上述报错,不需要退版本,当前版本使用v0.6.8-alpha.6。 |
是的,直接使用ollama会有这样报错,改成自定义渠道即可.或者降级到0.67版本 |
确认使用自定义可以。 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
例行检查
问题描述
使用ollama本地部署qwen2:7b,one-api测试成功,使用next-chat对话时出现报错:
{
"error": true,
"message": "empty response from server"
}
one-api日志报错:
[SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value
复现步骤
预期结果
相关截图
The text was updated successfully, but these errors were encountered: