Local LLM and Autogen

[Foolafroos]

Hello Everyone !

Did you try to make it run on a local Setup ?

I tried by replacing the Configlist by a local one
#create the Configuration of your environnement
config_list = [
{
"api_type": "open_ai",
"api_base": "http://localhost:1234/v1",
"api_key": "NULL",
},
]

and replacing all the gpt4_config instance by llm_config=llm_config, .

I am having api issue. not surprising... but i was wondering if you already made it run with a local LLM and if you had any tips if so?

Thanks ! Discovered Panel trhough your video btw :)

[aaronson2012]

its "base_url" not "api_base". also i dont think you need "api_type"