Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ollama部署qwen2:7b api调用报错 #1646

Open
4 of 5 tasks
wxiaoxiaow opened this issue Jul 13, 2024 · 7 comments
Open
4 of 5 tasks

ollama部署qwen2:7b api调用报错 #1646

wxiaoxiaow opened this issue Jul 13, 2024 · 7 comments
Labels
bug Something isn't working

Comments

@wxiaoxiaow
Copy link

wxiaoxiaow commented Jul 13, 2024

例行检查

  • 我已确认目前没有类似 issue
  • 我已确认我已升级到最新版本
  • 我已完整查看过项目 README,尤其是常见问题部分
  • 我理解并愿意跟进此 issue,协助测试和提供反馈
  • 我理解并认可上述内容,并理解项目维护者精力有限,不遵循规则的 issue 可能会被无视或直接关闭

问题描述
使用ollama本地部署qwen2:7b,one-api测试成功,使用next-chat对话时出现报错:
{
"error": true,
"message": "empty response from server"
}
one-api日志报错:
[SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value [SYS] 2024/07/13 - 14:48:42 | error unmarshalling stream response: invalid character '}' after top-level value
复现步骤

预期结果

相关截图
image
image

@wxiaoxiaow wxiaoxiaow added the bug Something isn't working label Jul 13, 2024
@kouwenguang
Copy link

降低版本到0.6.6或以下版本可以解决。

@Luck0o0
Copy link

Luck0o0 commented Jul 16, 2024

降低版本到0.6.6或以下版本可以解决。

确实是的,降级就好了,这个问题太。。。。

@AndyX-Net
Copy link

AndyX-Net commented Jul 18, 2024

确实,不晓得后续版本能修复这个问题不:
one-api | [SYS] 2024/07/19 - 01:49:29 | One API v0.6.8-alpha.5 started

image

目前已经返回6.6版本:
image

@wxiaoxiaow
Copy link
Author

降低版本到0.6.6或以下版本可以解决。

前几天退到0.67版本可以正常调用。这个问题有点奇葩了

@rick903
Copy link

rick903 commented Jul 27, 2024

已解决,渠道类型不用 ollama,而是选择 自定义 类型即可避免上述报错,不需要退版本,当前版本使用v0.6.8-alpha.6。

@yegetables
Copy link

是的,直接使用ollama会有这样报错,改成自定义渠道即可.或者降级到0.67版本

@BBM-Freehub
Copy link

已解决,渠道类型不用 ollama,而是选择 自定义 类型即可避免上述报错,不需要退版本,当前版本使用v0.6.8-alpha.6。

确认使用自定义可以。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

7 participants