set_llm new method #24
Description
Problem Description
Currently when running an example, the set_llm() is overwriting one after the other.
Proposed Solution
We need to create a utility set_llm method to check the for the api in env and to return the model with the API that is available.
Alternative Solutions
No response
Additional Context
- The user should be able to send he set_llm() method the provider and llm they want to use and the set_llm should try to use the [API,model] requested by the user and if this their not available, check which ones do, and fallback to them.
- First llm should be sonnet 3.7 by anthropic, then got-4o but OAI, then sonnet 3.5 and then gemini-2.0-flash-exp by google, then all other models that are requested/used by the community
- list of available models is 'o3-mini', 'qwen-plus', 'deepseek'
- other models TBD per community request