Skip to content

Conversation

@jimbobbennett
Copy link
Contributor

@jimbobbennett jimbobbennett commented Nov 12, 2025

New SDK Example

This adds a new Python example showing how to run an experiment against an application that has RAG and Tools.

This is code related to https://app.shortcut.com/galileo/story/38283/guide-to-run-experiments-in-2-0-for-a-simple-rag-application.

This code references a new how-to guide added in rungalileo/docs-official#473. These 2 PRs need to be merged at the same time.

This is a draft PR as it is missing TypeScript code at the moment.

Blocked on https://app.shortcut.com/galileo/story/46384/experiments-run-using-a-custom-function-do-not-finish-calculating

Before submitting

  1. Test Your Example: Ensure it runs correctly
  2. Update Documentation: Verify README is complete and accurate
  3. Check Dependencies: Ensure all dependencies are properly listed
  4. Environment Variables: Provide .env.example file
  5. Code Review: Self-review your code for quality

PR checklist

  • Example runs successfully
  • README.md is complete and accurate
  • Dependencies are properly listed
  • Environment variables are documented
  • Code follows style guidelines
  • Galileo integration is properly implemented
  • Tests pass (if applicable)
  • No sensitive data is included

Description

Brief description of what this example demonstrates.

Type of example

  • Agent
  • Chatbot
  • RAG
  • Dataset & Experiments

Language

  • Python
  • TypeScript

Key features

  • Experiment against a chatbot
  • RAG and tool spans in the experiment

Testing

  • Example runs successfully
  • README instructions work
  • Galileo integration tested

Screenshots/Demo

(If applicable)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants