Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MiniMax 流式格式好像有问题 #1394

Open
5 tasks done
QAbot-zh opened this issue Apr 29, 2024 · 6 comments
Open
5 tasks done

MiniMax 流式格式好像有问题 #1394

QAbot-zh opened this issue Apr 29, 2024 · 6 comments
Labels
bug Something isn't working

Comments

@QAbot-zh
Copy link

例行检查

  • 我已确认目前没有类似 issue
  • 我已确认我已升级到最新版本
  • 我已完整查看过项目 README,尤其是常见问题部分
  • 我理解并愿意跟进此 issue,协助测试和提供反馈
  • 我理解并认可上述内容,并理解项目维护者精力有限,不遵循规则的 issue 可能会被无视或直接关闭

问题描述
流式响应格式跟OpenAI的标准格式稍微有差别,最后一条data不是 chunk["choices"][0]["delta"]["content"] 的格式。
不影响在Nextchat里使用,对程序调用有一点小影响,不过算是小问题,要是oneapi能修下更完美。

复现步骤
调用Minimax相关模型,设置 stream=True。如果需要调试,可以提供key。

相关截图
Minimax 流式响应:
image
gpt 流式响应:
image

@QAbot-zh QAbot-zh added the bug Something isn't working label Apr 29, 2024
@QAbot-zh
Copy link
Author

另外发现Minimax日志token无数据
image

@songquanpeng
Copy link
Owner

ack

@songquanpeng
Copy link
Owner

v0.6.6-alpha.12 处理了没有 prompt token 的问题,这是因为他本身就没有返回,之前没有注意

@songquanpeng
Copy link
Owner

这个流式的问题还没解决

@QAbot-zh
Copy link
Author

好的,我的调用程序因为修复了这个小问题带来的影响所以没注意,以为一起修复了,群主认真严谨 😁

@kitaev-chen
Copy link

minimax abab6.5s-chat 回答截断这个问题似乎还存在

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants