Skip to content

Commit 815ddbc

Browse files
committed
feat: add llamaindex completion example
1 parent 25a703d commit 815ddbc

File tree

2 files changed

+13
-0
lines changed

2 files changed

+13
-0
lines changed

interweb-server/src/test/python/env.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,3 +8,4 @@ dependencies:
88
- langchain-openai
99
- llama-index
1010
- llama-index-embeddings-openai
11+
- llama-index-llms-openai-like

interweb-server/src/test/python/llamaindex_client.test.py

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,21 @@
11
import os
22
from llama_index.embeddings.openai import OpenAIEmbedding
3+
from llama_index.llms.openai_like import OpenAILike
4+
from llama_index.core.llms import ChatMessage, MessageRole
35

46
os.environ["OPENAI_API_BASE"] = os.getenv("INTERWEB_HOST", "https://interweb.l3s.uni-hannover.de/v1")
57
os.environ["OPENAI_API_KEY"] = os.getenv("INTERWEB_APIKEY")
68

9+
# Create a completion
10+
llm = OpenAILike(model="llama3.1:8b", is_chat_model=True) # gpt-4o-mini
11+
12+
resp = llm.chat([
13+
ChatMessage(role=MessageRole.SYSTEM, content="Always answer the question, even if the context isn't helpful."),
14+
ChatMessage(role=MessageRole.USER, content="What is your mission?"),
15+
])
16+
print(resp)
17+
18+
# Get Embeddings
719
embed_model = OpenAIEmbedding(
820
model_name="bge-m3:567m"
921
)

0 commit comments

Comments
 (0)