When using the embedded code, sometimes, the bot doesnt answer

[murchelon]

I belive it's the same issue in: #2291 (FlowiseAI/Flowise#2291)

Hi guys!

When I'm using the embedded version, the Bot stops answering, some questions. Sometimes it answers.. and other times it doesnt. I can see the animation that the bot is "typing", but it suddently stops sometimes.

Description:

• I have a bot in Flowizeai.com that is simple: a Conversational Retrieval QA chain with Pinecone as vector DB, OpenAI embeddings, and Redis as memory. It works perfectly — chatting about my RAG content while inside Flowizeai.com.

• I use the embedded version on my site. I'm using the latest embedded SDK and I believe Flowize.ai is using the latest Flowize.

• It was working fine until suddenly it became unstable: sometimes it answers correctly and other times it shows the bot as "typing", and moments later it just stops and shows no answer.

• When I check the messages in Flowize, I can see that the model responded — it just didn't show in the embedded bot.

• When checking the network session in Chrome DevTools, I can see that in the requests that worked there is data in the stream and response sessions. I can see several messages like this:

message: data:{"event":"token","data":" the answer..."}

• But when it doesn't work, I see nothing in the stream or response sessions.

• When I CURL the exact same bot, it ALWAYS works. Every time.

• I can provide screenshots and help debug it, if you want. I'm available for calls or anything you think is useful.

• I'm also a programmer and will try to investigate. If you have any direction or links/guides that might help, I'd be very thankful.

• I see no CORS or error messages. It was working fine for days, and suddenly this started.

• I suspect it's something related to websockets.

• I'm not sure whether it's server-side or client/embedded-side issue.

• One last comment: my site is inside SharePoint Online (Microsoft). I have a lot of experience with it and I don't believe it's at fault, but I can't completely rule it out — I needed to mention it.

• Do you have any advice or suggestions on how I could help debug this issue?

Thanks a lot.

Marcelo.

Prints and explanation:

In PRINT 1 Label 1, we can see that I type 2 questions.. and the bot answers nothing. When inspecting, I see that there were no data in the Stream and Response Sessions.

In PRINT 1 Label 2, a few seconds later, I type another thing.. but this time, there were a response. And then, I can see data in the Stream and Response Session.

this part I belive is important: Even in the (1) when the bot didnt answer.. I could see that he actualy answered, when I see the messages directly in Flowize. See PRINT 2 bellow

PRINT 1:

PRINT 2:

[murchelon]

Hi, just to give an update:

2 days after I posted this.. it started working, without any code changes.

thanks!

[toolsworkhub]

The problem is back.

[Aliasgarhaji110]

Guys any update I am still facing this issue and its very fustrating

[toolsworkhub]

Hi, I was debugging and I was thinking this is related to the Embedded version... but now, I think different:

I can reproduce the bug in Flowize cloud interface: It happens when I use a Conversational Retrieval QA Chain. If I use other node, the problem doent happen.

Other info:

• If I call it using curl, it works, even with a Conversational Retrieval QA Chain
• In the flowize cloud interface: when the bot doesnt answer.. if I close and open the chat window, the answer appear