How return multiple generations from the LLMChain?

[arthureberledev]

Hey,

i have a simple supabase edge function (deno) with the following content:

const llm = new ChatOpenAI({ modelName, n: 5 });
const prompt = DEFAULT_PROMPT;
const chain = new LLMChain({ prompt, llm, verbose: true });
const response = await chain.call({ description: "test" });

return new Response(JSON.stringify(response), {
  headers: { ...corsHeaders, "Content-Type": "application/json" },
});

My problem is that the "n" value doesn't change anything because chain.call(...) only returns the final answer even though i can see the multiple generations within the logs (when using verbose: true).

This happens because of the way chain.call is implemented. It actually calls _getFinalOutput which in turn returns generations[0].text; as you can see here: https://github.com/hwchase17/langchainjs/blob/78e00a363682d283a0a6445b9a655b8729ace9a1/langchain/src/chains/llm_chain.ts#L43

Is there currently any way to return all generations from a chain call?

Thanks in advance.