|
4 | 4 |
|
5 | 5 | [//]: # ([](LICENSE)) |
6 | 6 |
|
7 | | -The examples below showcase how to use different agentic frameworks with the SAP provider via LiteLLM. |
8 | | -Users can access LLMs across all vendors (OpenAI, Google, Amazon, Mistral, SAP, ...) available in the Generative AI Hub. |
9 | | -Each framework example is described in a separate jupyter notebook. |
| 7 | +The examples showcase how to easily use different agentic frameworks with the "SAP provider" via LiteLLM. |
| 8 | + |
| 9 | +SAP customers can access LLMs across all vendors (OpenAI, Google, Amazon, Mistral, SAP, ...) available in the SAP Generative AI Hub. |
10 | 10 |
|
11 | 11 | 📚 **[View Online documentation](https://sap-contributions.github.io/litellm-agentic-examples/)** 📚 |
12 | 12 |
|
| 13 | +## Sap Generative AI Hub |
| 14 | +The [SAP Generative AI Hub](https://help.sap.com/docs/sap-ai-core/sap-ai-core-service-guide/large-language-models) |
| 15 | +enables customers to access large language models (LLMs) from various providers e.g., Gemini, ChatGPT, Claude, Mistral, ..., |
| 16 | +in a centralized manner. |
| 17 | + |
| 18 | +## LiteLMM |
| 19 | +[LiteLLM](https://www.litellm.ai) is an opensource library which supports 100+ LLMs from various providers. |
| 20 | +LiteLLM acts as the bridge to use standard open-source frameworks via the OpenAI api. LiteLLM integrates with various |
| 21 | +LLM providers. The "SAP provider" is recently added to LiteLLM to support LLMs in the SAP Generative AI Hub. |
| 22 | + |
| 23 | + |
| 24 | + |
13 | 25 | ## Prerequisites |
14 | 26 | - [SAP AI Core Gen AI subscription via SAP BTP tenant.](https://help.sap.com/docs/sap-ai-core/sap-ai-core-service-guide/enabling-service-in-cloud-foundry) |
15 | 27 | - Install latest Litellm (includes SAP provider). |
16 | 28 |
|
17 | | -## 1. Langgraph |
| 29 | +## Examples Overview |
| 30 | +The following examples include python code and jupyter notebooks to demonstrate the integration step by step. |
| 31 | + |
| 32 | +### 1. Langgraph |
18 | 33 | * [langgraph_agent notebook](langgraph_example/langgraph_agent.ipynb) |
19 | 34 |
|
20 | | -## 2. CrewAI |
| 35 | +### 2. CrewAI |
21 | 36 | * [crewai_litellm_lib notebook](crewai_example/crewai_litellm_lib.ipynb) |
22 | 37 | * [crewai_litellm_proxy notebook](crewai_example/crewai_litellm_proxy.ipynb) |
23 | 38 |
|
24 | | -## 3. PydanticAI |
| 39 | +### 3. PydanticAI |
25 | 40 | * [pydanticai_litellm_proxy notebook](pydantic_ai_example/pydantic_ai_litellm_proxy.ipynb) |
26 | 41 |
|
27 | | -## 4. Google ADK |
| 42 | +### 4. Google ADK |
28 | 43 | * [google_adk notebook](google_adk_example/google_adk.ipynb) |
29 | 44 |
|
30 | | -## 5. OpenAI ADK |
| 45 | +### 5. OpenAI ADK |
31 | 46 | * [openai_adk notebook](openai_adk_example/openai_adk.ipynb) |
32 | 47 |
|
33 | | -## 6. AWS |
| 48 | +### 6. AWS |
34 | 49 | * [aws_strands notebook](aws_strands_example/aws_strands.ipynb) |
35 | 50 |
|
36 | | -## 7. LlamaIndex |
| 51 | +### 7. LlamaIndex |
37 | 52 | * [Llamaindex_litellm notebook](Llamaindex_example/Llamaindex_litellm.ipynb) |
38 | 53 |
|
39 | | -## 8. smolagents |
| 54 | +### 8. smolagents |
40 | 55 | * [smolagents_litellm notebook](smolagents_example/smolagents_litellm.ipynb) |
41 | 56 |
|
42 | | -## 9. Microsoft Agent Framework |
| 57 | +### 9. Microsoft Agent Framework |
43 | 58 | * [microsoft_agent_litellm_proxy notebook](microsoft_agent_example/microsoft_agent_litellm_proxy.ipynb) |
44 | 59 |
|
45 | | -## 10. Agentscope |
| 60 | +### 10. Agentscope |
46 | 61 | * [agentscope_litellm notebook](agentscope_example/agentscope_litellm.ipynb) |
47 | 62 |
|
48 | | -## 11. AG2 |
| 63 | +### 11. AG2 |
49 | 64 | * [ag2_litellm notebook](ag2_example/ag2_litellm_proxy.ipynb) |
50 | 65 |
|
51 | 66 |
|
|
0 commit comments