How to consume KRAGEN with LLM?

[atljoseph]

Is there an example of KRAGEN being used by an LLM? Looks like a cool project, but having trouble seeing where “the rubber meets the road”. Thank you

[miguelehernandez]

Dear user,
Yes, there is an example to run some queries described at the end of the README.md in this repo. Now, with respect to the LLM, if you follow the installation process, KRAGEN will be connected to an LLM using your OpenAI account running queries using the OpenAI API for ChatGPT3.5 or 4 depending on your OpenAI account. Please check it out and let me know if you still have questions. Here is the text:

"If you used the sample dataset, try asking "what genes are associated with caffeine?" and analyze the thought flow!"

Very straight forward... Let us know your experience using it!
Miguel

[atljoseph]

It’s cool that this can be used to look up something with the provided UI. That is not what I’m asking though. Am asking how to actually use this with an LLM. Thank you. Queries are a play toy unless an LLM can consume it.

…

On Fri, May 3, 2024 at 3:17 AM Miguel E. Hernandez ***@***.***> wrote: Dear user, Yes, there is an example to run some queries described at the end of the README.md in this repo. Please check it out and let me know if you still have questions. Here is the text: "If you used the sample dataset, try asking "what genes are associated with caffeine?" and analyze the thought flow!" Very straight forward... Let us know! Miguel — Reply to this email directly, view it on GitHub <#84 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AF632FPNB6RFWGYXGF6V4VDZAM2ZNAVCNFSM6AAAAABHDV2ARKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOJSGQ2DKMRZGA> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[huycke]

ChatGPT is a large language model. Are you talk about a local model, one being run on your computer?

[atljoseph]

Yes. Local. Ollama. But also, is this something to be used in another tool, or encapsulated to itself?

…

On Thu, May 9, 2024 at 11:26 AM huycke ***@***.***> wrote: ChatGPT is a large language model. Are you talk about a local model, one being run on your computer? — Reply to this email directly, view it on GitHub <#84 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AF632FLESZGQ5JROX4OZKSTZBOISFAVCNFSM6AAAAABHDV2ARKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBSHA4DGNZSGQ> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[chozillla]

I also am in need of Ollama support or something not reliant on an API