Skip to content

自定义大模型无响应问题 #461

Description

@FengtaoTien

当我在idea中自定义一个大模型时,测试链接显示通过,但是在ai对话框里似乎没有影响。
1、自定义模型时,stream参数勾选效果与显示指定stream参数效果好像不一样,当我指定"stream": 0时,测试链接显示成功,但是此时跟ai对话是没有反应的

Image

2、自定义模型时,stream参数勾选上,不显示定义stream参数,测试链接显示400,似乎传递到后端的参数类型不相符。去掉勾选,显示指定,"stream": 1时,可以得到返回值,但是流式结果是解析不了的,报错如下
Test Connection:
Connectionfailed:cannotparse withresponseResolver:$.result.content,ori data: data:(data:"id":*chatcmpl-297481cb2051b1e050903f57fba436b9",data:"index":0,data:"result":"",data:"role":"",data:"toolcalls":null,data:"finishreason":false,data:
返回结果形如:
data:{
data: "id" : "chatcmpl-5a7eb967-3139-45e5-83de-473cb9e543bf",
data: "index" : 0,
data: "result" : "",
data: "role" : "",
data: "tool_calls" : null,
data: "finish_reason" : false,
data: "finish_detail" : null,
data: "usage" : null,
data: "audioUsage" : null,
data: "extraReturn" : null

问题:
1)自定义模型参数"stream"只支持0或1时,而不是true或false,此时智能显示定义在请求体中,但是下次在再打开时,显示定义参数就丢失了
2)对于自定义大模型,是不是不支持流式返回结果?
3)非流式结果,测试链接通过,为何ai对话无响应?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions