How to add LLM and LORA instead of OpenAI API?

[mironkraft]

Hi, I would like to know how we can manage this since I am not interested on calling API

I would like to load a LLM such as vicuna and a LORA trained for this chat

Thanks, kind regards!