[Docs] AGE-3418 Docs for evaluation SDK by mmabrouk · Pull Request #2943 · Agenta-AI/agenta

Add new category for 'Evaluation from SDK' in JSON configuration

mmabrouk

committed

Add quick start guide and example notebook for Agenta SDK evaluations

mmabrouk

committed

Update tutorial links and add new Jupyter notebooks for capturing user feedback and Langchain observability. Adjusted paths in existing documentation to reflect new file structure.

mmabrouk

committed

Update .gitignore to include all files and directories in the tests/datalayer/results path.

mmabrouk

committed

Add documentation for managing testsets in Agenta SDK

mmabrouk

committed

Remove Jupyter notebook for evaluations with SDK, consolidating documentation and examples related to evaluation processes in Agenta.

mmabrouk

committed

Add documentation for configuring evaluators in Agenta SDK

mmabrouk

committed

Add documentation for configuring applications in Agenta SDK

mmabrouk

committed

Add documentation for running evaluations programmatically from the SDK

mmabrouk

committed

Update quick start guide to include troubleshooting resources for evaluation from SDK

mmabrouk

committed

Enhance quick start guide for Agenta SDK evaluations by adding OpenAI API key setup and refining the evaluation process steps. This update improves user experience by ensuring necessary credentials…

mmabrouk

committed

Update quick start guide to include OpenAI API key setup for LLM-as-a-judge evaluator and refine testset description. This enhances clarity for users configuring evaluations with the Agenta SDK.

mmabrouk

committed

Enhance quick start guide by adding evaluation name and description parameters in the Agenta SDK. This update improves clarity for users running evaluations and ensures proper configuration of eval…

mmabrouk

committed

Refactor testset management documentation by removing description parameter and updating example outputs. This enhances clarity and consistency in the Jupyter notebook and markdown files related to…

mmabrouk

committed

Add documentation for managing testsets and configuring evaluators in Agenta SDK

mmabrouk

committed

Refactor quick start guide by removing redundant header and improving structure. This change enhances readability and maintains focus on the evaluation creation process using the Agenta SDK.

mmabrouk

committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Docs] AGE-3418 Docs for evaluation SDK#2943

[Docs] AGE-3418 Docs for evaluation SDK#2943
mmabrouk merged 16 commits intomainfrom
docs/AGE-3418-docs-for-new-evaluation-sdk

Commits on Nov 12, 2025

Add new category for 'Evaluation from SDK' in JSON configuration

Add quick start guide and example notebook for Agenta SDK evaluations

Update tutorial links and add new Jupyter notebooks for capturing user feedback and Langchain observability. Adjusted paths in existing documentation to reflect new file structure.

Update .gitignore to include all files and directories in the tests/datalayer/results path.

Add documentation for managing testsets in Agenta SDK

Remove Jupyter notebook for evaluations with SDK, consolidating documentation and examples related to evaluation processes in Agenta.

Add documentation for configuring evaluators in Agenta SDK

Add documentation for configuring applications in Agenta SDK

Add documentation for running evaluations programmatically from the SDK

Update quick start guide to include troubleshooting resources for evaluation from SDK

Enhance quick start guide for Agenta SDK evaluations by adding OpenAI API key setup and refining the evaluation process steps. This update improves user experience by ensuring necessary credentials…

Update quick start guide to include OpenAI API key setup for LLM-as-a-judge evaluator and refine testset description. This enhances clarity for users configuring evaluations with the Agenta SDK.

Enhance quick start guide by adding evaluation name and description parameters in the Agenta SDK. This update improves clarity for users running evaluations and ensures proper configuration of eval…

Refactor testset management documentation by removing description parameter and updating example outputs. This enhances clarity and consistency in the Jupyter notebook and markdown files related to…

Add documentation for managing testsets and configuring evaluators in Agenta SDK

Refactor quick start guide by removing redundant header and improving structure. This change enhances readability and maintains focus on the evaluation creation process using the Agenta SDK.