System.Text.Json.JsonException The JSON value could not be converted to System.String. Path: $.error.code | LineNumber: 0 | BytePositionInLine: 20.

[SunnyLeu]

Describe the bug
I use the api as normal, but it shows System.Text.Json.JsonException
The JSON value could not be converted to System.String. Path: $.error.code | LineNumber: 0 | BytePositionInLine: 20.

Your code piece

ChatCompletionCreateRequest chatCompletionCreateRequest = new ChatCompletionCreateRequest {
    Messages = new List<ChatMessage>(),
    Model = Model,
};

ChatCompletionCreateResponse chatCompletionCreateResponse;
try {
    chatCompletionCreateResponse = await openAiService.ChatCompletion.CreateCompletion(chatCompletionCreateRequest);
} catch (Exception ex) {
    Console.WriteLine($"{ex.GetType().FullName}<br>{ex.Message}");
    throw;
}

Result
System.Text.Json.JsonException
The JSON value could not be converted to System.String. Path: $.error.code | LineNumber: 0 | BytePositionInLine: 20.
InvalidOperationException: Cannot get the value of a token type 'Number' as a string.
at System.Text.Json.ThrowHelper.ReThrowWithPath(ReadStack& state, Utf8JsonReader& reader, Exception ex)
at System.Text.Json.Serialization.JsonConverter`1.ReadCore(Utf8JsonReader& reader, JsonSerializerOptions options, ReadStack& state)
at System.Text.Json.JsonSerializer.ContinueDeserialize[TValue](ReadBufferState& bufferState, JsonReaderState& jsonReaderState, ReadStack& readStack, JsonTypeInfo jsonTypeInfo)
at System.Text.Json.JsonSerializer.ReadFromStreamAsync[TValue](Stream utf8Json, JsonTypeInfo jsonTypeInfo, CancellationToken cancellationToken)
at System.Net.Http.Json.HttpContentJsonExtensions.ReadFromJsonAsyncCore[T](HttpContent content, Encoding sourceEncoding, JsonSerializerOptions options, CancellationToken cancellationToken)
at OpenAI.Extensions.HttpClientExtensions.PostAndReadAsAsync[TResponse](HttpClient client, String uri, Object requestModel, CancellationToken cancellationToken)
at OpenAI.Managers.OpenAIService.CreateCompletion(ChatCompletionCreateRequest chatCompletionCreateRequest, String modelId, CancellationToken cancellationToken)
at 【MyCode】

Expected behavior
API returns ChatGPT's reply

Screenshots

Desktop (please complete the following information):

• OS: Windows 11
• Language C#

[SunnyLeu]

https://status.openai.com

OK, I think I found the problem, OpenAI is having issue of their services.

[mikemike396]

Seems to be back up. Error went away for us.

[kayhantolga]

seems like openai outage, if not please reopen the issue

[xbaha]

Re-pen the issue.

It's not OpenAI outage problem.,
I just received the exact error:

Message | "The JSON value could not be converted to System.String. Path: $.error.code \| LineNumber: 0 \| BytePositionInLine: 20." 

		SerializationStackTraceString	"   at System.Text.Json.ThrowHelper.ReThrowWithPath(ReadStack& state, Utf8JsonReader& reader, Exception ex)\r\n   at System.Text.Json.Serialization.JsonConverter`1.ReadCore(Utf8JsonReader& reader, JsonSerializerOptions options, ReadStack& state)\r\n   at System.Text.Json.Serialization.Metadata.JsonTypeInfo`1.ContinueDeserialize(ReadBufferState& bufferState, JsonReaderState& jsonReaderState, ReadStack& readStack)\r\n   at System.Text.Json.Serialization.Metadata.JsonTypeInfo`1.DeserializeAsync(Stream utf8Json, CancellationToken cancellationToken)\r\n   at System.Net.Http.Json.HttpContentJsonExtensions.ReadFromJsonAsyncCore[T](HttpContent content, JsonSerializerOptions options, CancellationToken cancellationToken)\r\n   at OpenAI.Extensions.HttpClientExtensions.PostAndReadAsAsync[TResponse](HttpClient client, String uri, Object requestModel, CancellationToken cancellationToken)\r\n   at OpenAI.Managers.OpenAIService.CreateCompletion(ChatCompletionCreateRequest chatCompletionCreateRequest, String modelId, CancellationToken cancellationToken)\r\n   at YouTubeSponseredByScheduler.Tasks.ChatGPT.GenerateResponse2(String FromSystem, String FromUser, Nullable`1 Temperature, Int32 modelSize) 

When i am sending around 2k tokens and expecting back another 3-4k tokens, the API works, once i increase the tokens > 4k and expect back 6k tokens i get this error.
the request took about 7-8 minutes to get the response.
in openAI, the request seems to be processed because the tokens are in my usage and I got charged for it.
so the only problem left is json parser,
if someone can let me know where can i find the data received before it was processed to json object, i might be able to debug the json problem.

[kayhantolga]

@xbaha, I believe you are encountering a different issue, but I will keep this issue open. I think the SDK should provide more information about errors in such cases. If possible, it would be helpful to reproduce the issue in my client. If your prompt is not private, could you share it? Alternatively, You can use Laser Cat Eyes to debug APIs (sample usage available in the playground). You can observe the incoming response and share it with us.

[xbaha]

hi, Thank you for reopening this issue.
I have uploaded my prompt here:

https://we.tl/t-S31MpkODAV

use gpt3.5 turbo 16k, temp=0.0f
add this to the client because it takes long time:

            var openAiService = new OpenAIService(new OpenAiOptions()
            {
                ApiKey = apiKey2
            }, 
            new HttpClient()
            {
                Timeout = TimeSpan.FromMinutes(50)
            });

I just tested it and I got this error.

[roldengarm]

Just wanted to add that error handling is not ideal at the moment by the looks of it. The SDK seems to throw an InvalidOperationException when OpenAI returns a 502 or 503 error. Screenshot below from our App Insights logs during the outage last week.

Is there any way to catch the actual error thrown by OpenAI, such that we can show a proper message in the UI?
We're still on betalgo.openai.gpt3

[kayhantolga]

@roldengarm OpenAI is supposed to return an error message and code when encountering issues. These fields are available through the SDK response. However, in cases where a proper response cannot be returned due to an outage or internal error, the SDK is unable to provide more details. I am planning to improve this behavior in the future, but for now, my suggestion is to return an unexpected error message :/

[kayhantolga]

@xbahaI attempted to use your sample, and it took 8 minutes to receive a response, but it was successful. The only exception I was able to reproduce was a timeout error when I set the timeout value to less than 8 minutes.

[xbaha]

@kayhantolga have you tried it with the Nuget package? I never tried laser CatEyes and not sure why you tried it there because the prompt works as i mentioned works in openAi but not in this c# package. , if you can try it on c# and see if you get an exception or not.

[kayhantolga]

@xbaha Lasercateyes is a tool that simply displays incoming and outgoing data. I tried using the source code(in playground project), but now I'm going to try using the NuGet package again. They should behave in the same way, but let's see.