feat: LiteLLM backend

[HendrikStrobelt]

No description provided.

[HendrikStrobelt]

cleanup and tracking with main still needs to be done.

[mergify]

Merge Protections

Your pull request matches the following merge protections and will not be merged until they are valid.

🟢 Enforce conventional commit

Wonderful, this rule succeeded.

Make sure that we follow https://www.conventionalcommits.org/en/v1.0.0/

• title ~= ^(fix|feat|docs|style|refactor|perf|test|build|ci|chore|revert)(?:\(.+\))?:

[jakelorocco]

looks like the test that failed only fails intermittently (and isn't related to this PR); opened a separate issue to track it: #121

[jakelorocco]

a few comments on tools and tests; the rest lgtm after chatting about unknown model_options

[jakelorocco]

looks like the litellm tests are failing; I'm not sure if it's a limitation with litellm / ollama. the rest lgtm

test/backends/test_litellm_ollama.py::test_litellm_ollama_chat XFAIL     [ 10%]
test/backends/test_litellm_ollama.py::test_litellm_ollama_instruct XFAIL [ 11%]
test/backends/test_litellm_ollama.py::test_litellm_ollama_instruct_options XFAIL [ 11%]

[nrfulton]

LGTM.

[HendrikStrobelt]

looks like the litellm tests are failing; I'm not sure if it's a limitation with litellm / ollama. the rest lgtm

test/backends/test_litellm_ollama.py::test_litellm_ollama_chat XFAIL     [ 10%]
test/backends/test_litellm_ollama.py::test_litellm_ollama_instruct XFAIL [ 11%]
test/backends/test_litellm_ollama.py::test_litellm_ollama_instruct_options XFAIL [ 11%]

I think that's consistent with the @pytest.mark.qualitative annotations of other backend tests (wtasonx, openai, .. )

Dismissing so it's not needed when things are fixed.

[HendrikStrobelt]

merging after fixing some merge-issue