The response ended prematurely.

[tianqingshuilan]

Describe the bug
When accessing the web front-end and chatting with ChatGPT, there will be occasional interruptions during the chat process. Check the log and find that the error is: System.IO.IOException: The response ended prematurely.

Your code piece

// in My Service
await foreach (var completion in completionResult)
{
    if (completion.Successful)
    {
        string res = completion.Choices.First().Message.Content;
        jm.code = 0;
        jm.data = res;
        jm.msg = "OK";
        yield return jm;
        sb.Append(res);
    }
    else
    {
        jm.code = -1;
        if (completion.Error == null)
        {
            throw new Exception("Unknown Error");
        }

        sb.AppendLine();
        jm.msg = $"{completion.Error.Code}: {completion.Error.Message}";
        _cache.Remove($"{_user.ID}-ing");

        noErr = false;
        yield return jm;
    }
}

// in MyControllerAction
await foreach (var item in _apiServices.ChatYield(userMessage, sysMessage))
{
    byte[] msgBytes = Encoding.UTF8.GetBytes($"data: {JsonConvert.SerializeObject(new { code = item.code, data = item.data, msg = item.msg })}\r\r");
    await Response.Body.WriteAsync(msgBytes, 0, msgBytes.Length);
    await Response.Body.FlushAsync();

    if (item.code != 0)
    {
        NLogUtil.WriteAll(NLog.LogLevel.Error, LogType.ApiRequest, "Chat Err", item.msg);
    }
}

Result
The stack information location of exception handling is in the Service await foreach line of code.

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

• OS: docker-debian
• Language [c#]
• Version [6.8.3]

Additional context
None.

[kayhantolga]

This issue may be related to #243 or #254. Please take a look at both of these. If they don't solve your issue, please reopen the issue.