Skip to content

Commit 648da11

Browse files
docs: edit experiment runner sdk
1 parent 4bb5f9e commit 648da11

File tree

1 file changed

+15
-0
lines changed

1 file changed

+15
-0
lines changed

pages/docs/evaluation/experiments/experiments-via-sdk.mdx

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -150,6 +150,21 @@ Run experiments directly on datasets stored in Langfuse for automatic tracing an
150150
{/* PYTHON SDK */}
151151

152152
```python
153+
from langfuse import get_client
154+
from langfuse.openai import OpenAI
155+
156+
# Initialize client
157+
langfuse = get_client()
158+
159+
# Define your task function
160+
def my_task(*, item, **kwargs):
161+
question = item.input # `run_experiment` passes a `DatasetItemClient` to the task function. The input of the dataset item is available as `item.input`.
162+
response = OpenAI().chat.completions.create(
163+
model="gpt-4.1", messages=[{"role": "user", "content": question}]
164+
)
165+
166+
return response.choices[0].message.content
167+
153168
# Get dataset from Langfuse
154169
dataset = langfuse.get_dataset("my-evaluation-dataset")
155170

0 commit comments

Comments
 (0)