🎉 Thanks for your interest in contributing to Vero-Eval — an open-source framework for evaluating AI pipelines and LLM systems.
We welcome all kinds of contributions — from bug fixes and documentation improvements to new metrics, reports, and test generators.
We follow the Fork → Branch → Pull Request (PR) workflow (visual guide here).
-
Fork this repository and create your branch from
main. -
Clone your fork locally.
-
Create a new branch for your feature or fix:
git checkout -b new-feature # give any name you want;) -
Create a virtual environment using Python 3.12 (We recommend using uv to create venv and installing dependencies):
uv venv .venv --python 3.12 #if using python : python -m venv venv source venv\Scripts\activate # On Windows source venv/bin/activate # On macOS/Linux
-
Install dependencies:
uv pip install -r requirements.txt
-
Follow existing code patterns and include a clear docstring and references.
-
Commit and push your changes to your fork.
-
Open a Pull Request against the main branch with a clear title and description.
Docs live on the docs branch under /docs directory. We use Markdown for static pages.
You can contribute by:
- Fixing typos or improving explanations.
- Adding usage examples.
- Writing how-to guides or tutorials.
To update the docs, create a branch from
docs, make your changes, and open a PR against thedocsbranch.
- Check that your changes pass all tests.
- Ensure the code is formatted and linted correctly.
- Tag relevant maintainers or issues if applicable.
- Keep PRs focused and small.
- Add or update tests for all new features.
- Update docs where applicable.
-
Ask questions or suggest ideas in GitHub Discussions
-
Report bugs via Issues
🤝 Join our Discord for real-time collaboration.