BlendeBot 2.0 and Internet Search

[jh-skaion]

Hello team,
i have been experimenting with blenderbot2.0 and internet search and i am trying to understand how the text generation works.
for example i asked the question: "i am doing fine. what is the latest with the terrorist attack at the airport in Kabul?"
it went through online searches where i can see it gather up to date information like:

but the response was: "I'm not sure, I haven't heard anything about it. Do you have a source for that?"

can anyone from the team tell how it works or point me to some documentation i can use to understand this process?

thank you
Juan

[jh-skaion]

This is another example:

[jh-skaion]

@stephenroller @klshuster

[klshuster]

The model attends to documents using the Fusion-in-Decoder method (FiD); see the original paper for more details of how the model incorporates external documents.

Admittedly, sometimes the model does not attend to the documents, for a variety of reasons. Your second example, however, shows some attention (4th highest mountain is part of the retrieved knowledge).

[jh-skaion]

thanks for the response. i will read the paper to have a better understanding.

is there a search engine you can recommend?

[klshuster]

if you search around the ParlAI issues there are several suggested search engines