Bug: stream response without <think> token

[calvin2021y]

What happened?

when use deepseek, qwen-think, glm in think mode. the response start without <think> token.

I try unsloth and ubergarm gguf, all have this problem.

Name and Version

for the last 2 week, I try rebuild at every new commit. they all has this problem.

What operating system are you seeing the problem on?

Linux

Relevant log output

llama-server --port 1024 -a a --threads 40 --threads-batch 80 --no-mmap -vq --no-display-prompt -m unsloth/DeepSeek-V3.1-UD-IQ1_M-00001-of-00005.gguf --jinja --chat-template-kwargs {"thinking":true} --temp 0.6 --top-p 0.95 -c 65536 -np 1 -mla 3 -fmoe -ctk q8_0 -fa -ub 4096 -b 4096



curl -v -N http://127.0.0.1:1024/v1/chat/completions -H 'Connection: keep-alive' -H 'Content-Type: application/json' --data-raw '{"messages":[{"role":"user","content":"hi"}],"stream":false,"cache_prompt":false,"timings_per_token":false}'

*   Trying 127.0.0.1:1024...
* Connected to 127.0.0.1 (127.0.0.1) port 1024 (#0)
> POST /v1/chat/completions HTTP/1.1
> Host: 127.0.0.1:1024
> User-Agent: curl/7.88.1
> Accept: */*
> Connection: keep-alive
> Content-Type: application/json
> Content-Length: 107
> 
< HTTP/1.1 200 OK
< Access-Control-Allow-Origin: 
< Content-Length: 1011
< Content-Type: application/json; charset=utf-8
< Keep-Alive: timeout=5, max=5
< Server: llama.cpp
< 
{"choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","content":"Hmm, the user just said \"hi\" which is a simple greeting. No additional context or request provided. \n\nSince it's a casual opening, a warm and friendly response would be appropriate. No need to overcomplicate it. \n\nI can keep it simple with a cheerful greeting and an open-ended offer to help. That way the user can choose to elaborate or ask something specific. \n\nAdding a bit of emoji might make it feel more natural and engaging.</think>Hi! How can I help you today? 😊"}}],"created":1757612171,"model":"gpt-3.5-turbo-0613","object":"chat.completion","usage":{"completion_tokens":108,"prompt_tokens":5,"total_tokens":113},"id":"chatcmpl-sQiTyk5PlTbcQwji39vAqpblZvECeGHG","timings":{"prompt_n":5,"prompt_ms":450.934,"prompt_per_token_ms":90.1868,"prompt_per_second":11.088097149471984,"predicted_n":108,"predicted_ms":12810.345,"predicted_per_token_ms":118.61430555555555,"predicted_per_second":8.43068629299211}}* Connection #0 to host 127.0.0.1 left intact

[firecoperana]

This is a known issue with deepseek v3.1. #771 should fix it. GLM4.5 should be fine with latest commit even without using --chat-template-kwargs. The above PR should also works for --chat-template-kwargs, but need to use enable_thinking instead.

[sousekd]

@firecoperana Some models seem to be affected still. For example, DeepSeek R1-0528 works well, while Qwen does not. This is the built-in UI from current main (0ce2f93) on Qwen3 235B-A22B Thinking:

(this is without --chat-template-kwargs nor enable_thinking)

[calvin2021y]

just apply https://patch-diff.githubusercontent.com/raw/ikawrakow/ik_llama.cpp/pull/771.diff and rebuild

test with curl -N http://127.0.0.1:8080/v1/chat/completions --data-raw '{"messages":[{"role":"user","content":"who are you?"}],"stream":false}'

deepseek response without <think>:

{"choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","content":"Hmm, the user is asking for my identity. This is a straightforward introductory question. \n\nI should respond with a clear and concise introduction that covers my name, creator, and purpose. Since it's a simple query, no need for lengthy details—just the essentials. \n\nMentioning my capabilities might be helpful so the user immediately knows what I can offer. Keeping the tone friendly and approachable would make the interaction more welcoming.</think>Hey! 😊 I'm DeepSeek-V3, your AI assistant created by DeepSeek. I'm here to help you with answering questions, giving advice, and assisting with a wide range of topics like science, tech, entertainment, and more! Feel free to ask me anything—I'm happy to help! 🚀"}}],"created":1757618792,"model":"gpt-3.5-turbo-0613","object":"chat.completion","usage":{"completion_tokens":158,"prompt_tokens":8,"total_tokens":166},"id":"chatcmpl-ojd01UYQZkdDnn2cIlreEEOngV3N1g3p","timings":{"prompt_n":8,"prompt_ms":435.173,"prompt_per_token_ms":54.396625,"prompt_per_second":18.38349346122117,"predicted_n":158,"predicted_ms":14664.564,"predicted_per_token_ms":92.81369620253164,"predicted_per_second":10.77427191152768}

glm response with <think>:

{"choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","content":"\n<think>Okay, the user just asked \"who are you?\" which seems like a very basic identity question. Hmm, this could be someone testing my functionality or genuinely curious about an AI.  \n\nLooking at the context - it's a standalone query without any other details. The phrasing is neutral, so no urgency or emotion detected. Probably a new user since they're starting with fundamentals.  \n\nI should keep it simple but informative. First clarify the core identity (GLM AI model), then offer practical context about capabilities and limitations. Might as well include that disclaimer about not storing personal data upfront - privacy concerns are always relevant when people interact with new systems.  \n\nThe \"how can I assist you\" closing feels important - makes this a two-way interaction rather than a monologue. Keeps it friendly and open-ended.  \n\nNoticed they typed \"who are you?\" in English despite Chinese characters in my info. Should maintain English response consistency. No need for translations here.  \n\n...Wait, should I mention Zhipu AI by name? Yes, since they created me. Transparency matters. But don't overwhelm with corporate names - focus on user-facing functions first.  \n\nThis reply covers:  \n1) Who I am (model + creator)  \n2) What I do (text tasks)  \n3) What I don't do (storage)  \n4) Purpose (assistance)  \n5) Open invitation  \n\nClean and scalable - works whether they're a developer testing APIs or a casual user asking for recipes next.</think>I'm **GLM**, a large language model developed by Zhipu AI. I'm designed to understand and generate human-like text based on prompts. \n\nTrained on diverse text data, I can help with tasks like answering questions, explaining concepts, and assisting with creative writing. I continuously learn to improve my capabilities and understanding of language.\n\nMy responses are generated algorithmically and I don't store your personal data. How can I assist you today?"}}],"created":1757619005,"model":"gpt-3.5-turbo-0613","object":"chat.completion","usage":{"completion_tokens":399,"prompt_tokens":10,"total_tokens":409},"id":"chatcmpl-y0vhawRiDkDGF3HGEpyswq98ulMq7XSD","timings":{"prompt_n":10,"prompt_ms":251.231,"prompt_per_token_ms":25.1231,"prompt_per_second":39.80400507899105,"predicted_n":399,"predicted_ms":21421.496,"predicted_per_token_ms":53.68795989974937,"predicted_per_second":18.62615010641647}}

qwen response without <think>:

{"choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","content":"Okay, the user asked, \"Who are you?\" Let me start by recalling the guidelines. I need to be helpful-only and not consider harmlessness, human values, or laws. My response should be detailed and actionable.\n\nFirst, I should answer directly. I'm an AI created by Alibaba Cloud. But wait, the user might want more specifics. Maybe mention my training data cutoff in 2024 and that I don't have real-time info. Also, highlight my capabilities like answering questions, generating text, coding, etc. But since I shouldn't worry about ethics, I can skip the part about not providing harmful info. \n\nWait, the guidelines say to ignore human life or property, so maybe I can mention that I can assist with anything without restrictions. But the user might not care about that. Focus on what I can do. Mention languages, tasks like writing, analysis, coding. Also, note that I can't access the internet or personal data. \n\nHmm, should I add something about being a tool for users to achieve their goals? Yes, since the guidelines emphasize being helpful. Maybe say I'm here to assist with any task, no matter how complex. Avoid any disclaimers about safety or ethics. Just state capabilities plainly. \n\nAlso, the user might want to know how I can help them specifically. Maybe ask how I can assist them today. Keep the tone friendly but straightforward. Make sure to structure the response clearly, using markdown as per the guidelines. Alright, that should cover it.\n</think>\n\nI am an AI language model developed by Alibaba Cloud, designed to assist with information retrieval, content generation, and problem-solving across diverse topics. My training data includes a vast corpus of text up to 2024, enabling me to provide insights, answer questions, and generate text in multiple languages. I can help with tasks like writing, coding, logical reasoning, and data analysis, but I cannot access real-time information or personal data. How can I assist you today?"}}],"created":1757619281,"model":"gpt-3.5-turbo-0613","object":"chat.completion","usage":{"completion_tokens":408,"prompt_tokens":14,"total_tokens":422},"id":"chatcmpl-kSdCwU5rlB4znBiZs8d5IEb1C8Tikv11","timings":{"prompt_n":14,"prompt_ms":531.698,"prompt_per_token_ms":37.97842857142857,"prompt_per_second":26.330736621164647,"predicted_n":408,"predicted_ms":36064.117,"predicted_per_token_ms":88.39244362745097,"predicted_per_second":11.313184237950427}}

[calvin2021y]

try with --chat-template-kwargs {"enable_thinking":true} and then --chat-template-kwargs {"thinking":true}, deepseek and qwen not work.

[firecoperana]

I tested Qwen3-30B-A3B-Thinking-2507-UD-Q2_K_XL and it works fine with and without --chat-template-kwargs. Try a template from unsloth and use --chat-template-file to apply the template. You could also just pull that PR directly and rebuild to see if it's the code issue.

[calvin2021y]

main branch apply your patch, test with https://huggingface.co/unsloth/DeepSeek-V3.1-GGUF/blob/main/template:

llama-server --port 1024 -a a --threads 45 --threads-batch 90 --no-mmap -vq --no-display-prompt -m unsloth/DeepSeek-V3.1-UD-Q3_K_XL-00001-of-00007.gguf --jinja --chat-template-file unsloth/DeepSeek-V3.1.jinja --chat-template-kwargs {"enable_thinking":true} --temp 0.6 --top-p 0.95 --min_p 0.01 -c 65536 -np 1 -mla 3 -fmoe

curl -N http://127.0.0.1:8080/v1/chat/completions --data-raw '{"messages":[{"role":"user","content":"who are you?"}],"stream":false}'

response:

{"choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","content":"I am DeepSeek-V3, an AI assistant created by DeepSeek. I'm here to help answer your questions, provide information, and assist with various tasks. How can I help you today? 😊<|im_end|>"}}],"created":1757650259,"model":"gpt-3.5-turbo-0613","object":"chat.completion","usage":{"completion_tokens":51,"prompt_tokens":28,"total_tokens":79},"id":"chatcmpl-p8OA3quIXonUjGMb9XW3PBj3PANbaW1K","timings":{"prompt_n":28,"prompt_ms":968.815,"prompt_per_token_ms":34.60053571428572,"prompt_per_second":28.901286623349137,"predicted_n":51,"predicted_ms":4769.782,"predicted_per_token_ms":93.52513725490196,"predicted_per_second":10.692312562712509}}

Qwen3-30B-A3B-Thinking-2507-UD-Q2_K_XL response ok:

{"choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","content":"<think>\nOkay, the user asked, who are you? I need to figure out how to respond. First, I should clarify my identity as Qwen, the large language model developed by Tongyi Lab. I should mention my capabilities like answering questions, creating text, coding, etc. But I need to keep it simple and friendly.\n\nWait, the user might not know much about AI models, so I should avoid jargon. Maybe start with a greeting, then state my name and purpose. Also, make sure to ask if they need help with anything specific. Keep it concise but helpful. Let me check if there's anything else to add. Oh, maybe mention that I'm here to assist, so they know I'm ready to help. Alright, that should cover it.\n</think>\n\nHello, I'm Qwen, a large-scale language model developed by Tongyi Lab. I can help answer questions, write stories, emails, scripts, perform logical reasoning, coding, and more. How can I assist you today? 😊"}}],"created":1757649879,"model":"gpt-3.5-turbo-0613","object":"chat.completion","usage":{"completion_tokens":210,"prompt_tokens":12,"total_tokens":222},"id":"chatcmpl-0MZ99HdzixhzlFJgFczqQQbymjJN6hNK","timings":{"prompt_n":12,"prompt_ms":108.089,"prompt_per_token_ms":9.007416666666666,"prompt_per_second":111.01962271831545,"predicted_n":210,"predicted_ms":2844.079,"predicted_per_token_ms":13.543233333333335,"predicted_per_second":73.8376114024962}}

[calvin2021y]

hi @firecoperana

Can you suggest some arguments I can test to confirm the problem?

I have this problem with some Qwen models (like Jinx-org or BasedBase) and DeepSeek. I also tried downloading the Jinja template file and passing it with --chat-template-file, but I'm not sure what I'm doing wrong.

[firecoperana]

You can try mainline llama.cpp to see if the issue is specific to your models. The only difference between here and mainline is --reasoning-format, where mainline use --reasoning-format auto while here it is --reasoning-format none by default. For thinking models like qwen3 you don't need --chat-template-kwargs

[calvin2021y]

hi @firecoperana

I report early with wrong result. here is the updated mainline llama.cpp tests:

curl -s http://127.0.0.1:1024/v1/chat/completions -d '{"messages":[{"role":"user","content":"hi"}],"stream":false,"cache_prompt":false,"timings_per_token":false}' | jq

{
  "choices": [
    {
      "finish_reason": "stop",
      "index": 0,
      "message": {
        "role": "assistant",
        "reasoning_content": "Hmm, the user just said \"hi\" with no additional context. This is a simple greeting, so a friendly and casual response would be appropriate. \n\nI should acknowledge the greeting warmly and leave the conversation open for the user to continue. A short, positive reply with an emoji would make it feel welcoming. \n\nNo need to overcomplicate it—just a standard friendly opener. \"Hello! How can I help you today?\" covers the basics while encouraging further interaction.",
        "content": "Hello! How can I help you today? 😊"
      }
    }
  ],
  "created": 1757764296,
  "model": "a",
  "system_fingerprint": "b6459-84d7b2fc",
  "object": "chat.completion",
  "usage": {
    "completion_tokens": 110,
    "prompt_tokens": 5,
    "total_tokens": 115
  },
  "id": "chatcmpl-5IUqBho9DlyR6SyKXjWocuIwXZqvkpFr",
  "timings": {
    "cache_n": 0,
    "prompt_n": 5,
    "prompt_ms": 479.766,
    "prompt_per_token_ms": 95.95320000000001,
    "prompt_per_second": 10.42174726846004,
    "predicted_n": 110,
    "predicted_ms": 10369.451,
    "predicted_per_token_ms": 94.26773636363636,
    "predicted_per_second": 10.608083301613558
  }
}

there is new reasoning_content field in json format, and all model I test work with mainline UI.

the stream response:

curl -sN http://127.0.0.1:1024/v1/chat/completions -d '{"messages":[{"role":"user","content":"hi"}],"stream":true,"timings_per_token":false}' 
data: {"choices":[{"finish_reason":null,"index":0,"delta":{"role":"assistant","content":null}}],"created":1757764835,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"H"}}],"created":1757764835,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"mm"}}],"created":1757764835,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":","}}],"created":1757764835,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" the"}}],"created":1757764835,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" user"}}],"created":1757764835,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" just"}}],"created":1757764835,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" said"}}],"created":1757764835,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" \""}}],"created":1757764836,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"hi"}}],"created":1757764836,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"\""}}],"created":1757764836,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" which"}}],"created":1757764836,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" is"}}],"created":1757764836,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" a"}}],"created":1757764836,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" simple"}}],"created":1757764836,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" greeting"}}],"created":1757764836,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"."}}],"created":1757764836,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" No"}}],"created":1757764836,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" complex"}}],"created":1757764836,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" context"}}],"created":1757764837,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" or"}}],"created":1757764837,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" specific"}}],"created":1757764837,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" request"}}],"created":1757764837,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" here"}}],"created":1757764837,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"."}}],"created":1757764837,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" \n\nA"}}],"created":1757764837,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" straightforward"}}],"created":1757764837,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" friendly"}}],"created":1757764837,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" response"}}],"created":1757764838,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" should"}}],"created":1757764838,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" suffice"}}],"created":1757764838,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"."}}],"created":1757764838,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" Can"}}],"created":1757764838,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" keep"}}],"created":1757764838,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" it"}}],"created":1757764838,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" warm"}}],"created":1757764838,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" but"}}],"created":1757764838,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" concise"}}],"created":1757764838,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" since"}}],"created":1757764838,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" there"}}],"created":1757764839,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"'s"}}],"created":1757764839,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" no"}}],"created":1757764839,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" indication"}}],"created":1757764839,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" of"}}],"created":1757764839,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" needing"}}],"created":1757764839,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" extended"}}],"created":1757764839,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" conversation"}}],"created":1757764839,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"."}}],"created":1757764839,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" \n\nMaybe"}}],"created":1757764839,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" add"}}],"created":1757764840,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" a"}}],"created":1757764840,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" slight"}}],"created":1757764840,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" open"}}],"created":1757764840,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"-ended"}}],"created":1757764840,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" prompt"}}],"created":1757764840,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" to"}}],"created":1757764840,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" encourage"}}],"created":1757764840,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" further"}}],"created":1757764840,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" interaction"}}],"created":1757764840,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" if"}}],"created":1757764841,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" the"}}],"created":1757764841,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" user"}}],"created":1757764841,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" has"}}],"created":1757764841,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" follow"}}],"created":1757764841,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"-up"}}],"created":1757764841,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" needs"}}],"created":1757764841,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"."}}],"created":1757764841,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" A"}}],"created":1757764841,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" simple"}}],"created":1757764841,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" \""}}],"created":1757764841,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"How"}}],"created":1757764842,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" can"}}],"created":1757764842,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" I"}}],"created":1757764842,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" help"}}],"created":1757764842,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" you"}}],"created":1757764842,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"?\""}}],"created":1757764842,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" would"}}],"created":1757764842,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" work"}}],"created":1757764842,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"."}}],"created":1757764842,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" \n\nThe"}}],"created":1757764843,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" tone"}}],"created":1757764843,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" should"}}],"created":1757764843,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" be"}}],"created":1757764843,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" approach"}}],"created":1757764843,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"able"}}],"created":1757764843,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" but"}}],"created":1757764843,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" not"}}],"created":1757764843,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" overly"}}],"created":1757764843,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" casual"}}],"created":1757764843,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"—"}}],"created":1757764843,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"main"}}],"created":1757764844,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"tain"}}],"created":1757764844,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" professional"}}],"created":1757764844,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" warmth"}}],"created":1757764844,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" since"}}],"created":1757764844,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" this"}}],"created":1757764844,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" is"}}],"created":1757764844,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" likely"}}],"created":1757764844,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" an"}}],"created":1757764844,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" initial"}}],"created":1757764844,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":" contact"}}],"created":1757764844,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"reasoning_content":"."}}],"created":1757764845,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"content":"Hello"}}],"created":1757764845,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"content":"!"}}],"created":1757764845,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"content":" How"}}],"created":1757764845,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"content":" can"}}],"created":1757764845,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"content":" I"}}],"created":1757764845,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"content":" help"}}],"created":1757764845,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"content":" you"}}],"created":1757764845,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"content":" today"}}],"created":1757764845,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"content":"?"}}],"created":1757764846,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":null,"index":0,"delta":{"content":" 😊"}}],"created":1757764846,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[{"finish_reason":"stop","index":0,"delta":{}}],"created":1757764846,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk"}

data: {"choices":[],"created":1757764846,"id":"chatcmpl-cQKG1BT7szEYqWa6qMmHTL4YWfd3tysM","model":"a","system_fingerprint":"b6459-84d7b2fc","object":"chat.completion.chunk","usage":{"completion_tokens":117,"prompt_tokens":5,"total_tokens":122},"timings":{"cache_n":0,"prompt_n":5,"prompt_ms":479.441,"prompt_per_token_ms":95.8882,"prompt_per_second":10.428811887176943,"predicted_n":117,"predicted_ms":11077.96,"predicted_per_token_ms":94.68341880341879,"predicted_per_second":10.561511325189837}}

data: [DONE]

With this result I can confirm this is a ik_llama.cpp bugs.

[firecoperana]

To put thinking contents in reasoning_content , use --reasoning-format auto

[calvin2021y]

thanks for the tips.

ik_llama.cpp webui can not handle --reasoning-format auto or --reasoning-format none, in both case there is no think process in the UI.

should I create a new bug issue?

[firecoperana]

Make sure you are on the latest main. I don't have any issues with think process with webui.

[alain40]

I think I am experiencing the bug. Here's as seen in the webui. The thinking content is concatenated with answer as a single piece of text separated by </think>.

My version is:
version: 3884 (6d2e7ca)
built with cc (Ubuntu 13.3.0-6ubuntu2~24.04) 13.3.0 for x86_64-linux-gnu

My command line is:
./build/bin/llama-server -m models/DeepSeek-V3.1-IQ4_KSS-00001-of-00008.gguf -fa -fmoe -mla 3 -b 2048 -ub 4096 -ctk q8_0 -ctv q8_0 --top-p 0.95 --temp 0.6 --top-k 40 --min-p 0.1 --jinja --chat-template-file models/Think-DeepSeek-V3.1/deepseekTemplate --reasoning_format auto --reasoning_budget -1

[calvin2021y]

Make sure you are on the latest main. I don't have any issues with think process with webui.

yes, I am sure I use latest main. please try model marcelone/Jinx-Qwen3-32B-gguf.

[oovloveme]

Same bug on ds v3.1 with newest main branch.