|
| 1 | +# Contributing to LLM Search Quality Evaluation |
| 2 | + |
| 3 | +First of all, thank you for considering contributing to the **LLM Search Quality Evaluation** project. |
| 4 | + |
| 5 | + |
| 6 | +We welcome contributions from everyone. By participating in this project, you help us improve search quality evaluation standards for the community. |
| 7 | + |
| 8 | +## Overview |
| 9 | + |
| 10 | +* [How to Contribute](#how-to-contribute) |
| 11 | +* [Existing Issues](#existing-issues) |
| 12 | +* [Development Setup](#development-setup) |
| 13 | +* [Pull Request Process](#pull-request-process) |
| 14 | +* [Reporting Issues](#reporting-issues) |
| 15 | + |
| 16 | +---------- |
| 17 | + |
| 18 | + |
| 19 | +## How to Contribute |
| 20 | + |
| 21 | +There are several ways you can help: |
| 22 | + |
| 23 | +* **Report Issues:** If you find a bug/issue, please create a [github issue](https://github.com/SeaseLtd/llm-search-quality-evaluation/issues). |
| 24 | +* **Suggest Features:** Have an idea for a new metric or evaluation method? Open an issue to discuss it. |
| 25 | +* **Contribute To Existing Issues:** Tackle [open github issues](https://github.com/SeaseLtd/llm-search-quality-evaluation/issues) or submit new features. |
| 26 | + |
| 27 | +## Existing Issues |
| 28 | + |
| 29 | +We have a list of open issues that we need help with. This is the best place to start if you are looking for code contributions. |
| 30 | + |
| 31 | +* **[View Open Issues](https://github.com/SeaseLtd/llm-search-quality-evaluation/issues)** |
| 32 | + |
| 33 | +If you find an issue you would like to work on, please comment on it and so that to avoid duplicating work. |
| 34 | + |
| 35 | +## Development Setup |
| 36 | + |
| 37 | +To get started with the project, please follow the installation and setup instructions provided in our main documentation. |
| 38 | +Either you could go to the LLM search quality evaluation tutorial for detailed setup or just the LLM search quality evaluation README. |
| 39 | +* [LLM Search Quality Evaluation Tutorial README](https://github.com/SeaseLtd/llm-search-quality-evaluation-tutorial/blob/main/README.md) |
| 40 | +* [LLM Search Quality Evaluation README](https://github.com/SeaseLtd/llm-search-quality-evaluation/blob/main/README.md) |
| 41 | + |
| 42 | +Please make sure you can run the project locally before making changes. |
| 43 | + |
| 44 | +## Pull Request Process |
| 45 | + |
| 46 | +We use the standard GitHub "Fork & Pull" workflow. |
| 47 | +Fork our repo and once you have changes, commit them to your fork, then create a Pull Request (PR) to our repo. |
| 48 | + |
| 49 | +Before submitting a PR, please ensure: |
| 50 | +* [ ] Add unit test(s) and make sure you run all tests and they do pass. |
| 51 | +* [ ] If you added a new feature, update the README or relevant documentation. |
| 52 | +* [ ] Run `mypy` and `ruff` for type checking and finding issues/formatting. |
| 53 | + |
| 54 | +## Reporting Issues |
| 55 | + |
| 56 | +This section guides you through submitting a bug report. |
| 57 | + |
| 58 | +When opening a new issue, please include: |
| 59 | +1. **A clear title.** Descriptive, self-explanatory title |
| 60 | +2. **Description:** What the issue is about ? |
| 61 | +3. **Suggested approach:** (Optional) Any suggested idea to solve the problem if you have. |
| 62 | + |
| 63 | + |
| 64 | +**Questions?** |
| 65 | +If you have any questions, feel free to open a discussion in the Issues tab. |
| 66 | + |
| 67 | + |
| 68 | + |
0 commit comments