Merge branch 'docs/sample-reports' into feature/zero-shot-evaluation

Author: XiaoBoAI

.github/ISSUE_TEMPLATE/bug_report.md

@@ -0,0 +1,35 @@
+---
+name: Bug Report
+about: Create a report to help us improve
+title: '[Bug]:'
+labels: 'bug'
+assignees: ''
+
+---
+
+**<u>OpenJudge is an open-source project. To involve a broader community, we recommend asking your questions in English.</u>**
+
+**Describe the bug**
+A clear and concise description of what the bug is.
+
+**To Reproduce**
+Steps to reproduce the behavior:
+
+1. Code snippet that causes the bug:
+2. Steps to execute the code:
+3. Error message or unexpected behavior observed:
+
+**Expected behavior**
+A clear and concise description of what you expected to happen.
+
+**Error messages**
+Detailed error messages.
+
+**Environment (please complete the following information):**
+
+- OpenJudge Version: [e.g. 1.0.0 via `print(openjudge.__version__)`]
+- Python Version: [e.g. 3.10]
+- OS: [e.g. macos, windows]
+
+**Additional context**
+Add any other context about the problem here.

.github/ISSUE_TEMPLATE/custom.md

@@ -0,0 +1,12 @@
+---
+name: Custom issue template
+about: Describe this issue template's purpose here.
+title: ''
+labels: ''
+assignees: ''
+
+---
+
+**<u>OpenJudge is an open-source project. To involve a broader community, we recommend asking your questions in English.</u>**
+
+**Please describe your issue or question in detail below:**

.github/ISSUE_TEMPLATE/feature_request.md

@@ -0,0 +1,23 @@
+---
+name: Feature Request
+about: Suggest an idea for this project
+title: '[Feature]: '
+labels: 'enhancement'
+assignees: ''
+
+---
+
+**<u>OpenJudge is an open-source project. To involve a broader community, we recommend asking your questions in English.</u>**
+
+
+**Is your feature request related to a problem? Please describe.**
+A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
+
+**Describe the solution you'd like**
+A clear and concise description of what you want to happen.
+
+**Describe alternatives you've considered**
+A clear and concise description of any alternative solutions or features you've considered.
+
+**Additional context**
+Add any other context or screenshots about the feature request here.

.github/PULL_REQUEST_TEMPLATE.md

@@ -0,0 +1,17 @@
+## OpenJudge Version
+
+[The version of OpenJudge you are working on, e.g. `import openjudge; print(openjudge.__version__)`]
+
+## Description
+
+[Please describe the background, purpose, changes made, and how to test this PR]
+
+## Checklist
+
+Please check the following items before code is ready to be reviewed.
+
+- [ ]  Code has been formatted with `pre-commit run --all-files` command
+- [ ]  All tests are passing
+- [ ]  Docstrings are in Google style
+- [ ]  Related documentation has been updated (e.g. links, examples, etc.)
+- [ ]  Code is ready for review

README.md

@@ -30,6 +30,7 @@
 - [Quickstart](#-quickstart)
 - [Integrations](#-integrations)
 - [Contributing](#-contributing)
+- [Community](#-community)
 - [Citation](#-citation)
 
 OpenJudge is a unified framework designed to drive **LLM and Agent application excellence** through **Holistic Evaluation** and **Quality Rewards**.
@@ -188,9 +189,17 @@ We love your input! We want to make contributing to OpenJudge as easy and transp
 
 ---
 
+## 💬 Community
 
+Join our DingTalk group to connect with the community:
 
-### Migration Guide (v0.1.x → v0.2.0)
+<div align="center">
+<img src="./docs/images/dingtalk_qr_code.png" alt="DingTalk QR Code" width="200">
+</div>
+
+---
+
+## Migration Guide (v0.1.x → v0.2.0)
 > OpenJudge was previously distributed as the legacy package `rm-gallery` (v0.1.x). Starting from v0.2.0, it is published as `py-openjudge` and the Python import namespace is `openjudge`.
 
 **OpenJudge v0.2.0 is NOT backward compatible with v0.1.x.**

README_zh.md

@@ -30,6 +30,7 @@
 - [快速开始](#-快速开始)
 - [集成](#-集成)
 - [贡献](#-贡献)
+- [社区](#-社区)
 - [引用](#-引用)
 
 OpenJudge 是一个统一框架，旨在通过**全面评估**和**质量奖励**来提升 **LLM 和 Agent 应用效果**。
@@ -188,7 +189,17 @@ if __name__ == "__main__":
 
 ---
 
-### 迁移指南（v0.1.x → v0.2.0）
+## 💬 社区
+
+欢迎加入 OpenJudge 钉钉交流群，与我们一起讨论：
+
+<div align="center">
+<img src="./docs/images/dingtalk_qr_code.png" alt="钉钉群二维码" width="200">
+</div>
+
+---
+
+## 迁移指南（v0.1.x → v0.2.0）
 > OpenJudge 之前以旧包名 `rm-gallery`（v0.1.x）发布。从 v0.2.0 开始，它以 `py-openjudge` 发布，Python 导入命名空间为 `openjudge`。
 
 **OpenJudge v0.2.0 与 v0.1.x 不向后兼容。**

cookbooks/grader_validation/accuracy.py

@@ -8,8 +8,7 @@
 
 from typing import Dict, List
 
-from tutorials.grader_validation.base import GraderValidator
-
+from cookbooks.grader_validation.base import GraderValidator
 from openjudge.analyzer.base_analyzer import AnalysisResult
 from openjudge.analyzer.validation.accuracy_analyzer import AccuracyAnalyzer
 from openjudge.graders.base_grader import BaseGrader

cookbooks/grader_validation/rewardbench2.py

@@ -307,8 +307,10 @@ async def _evaluate_four_way(
             GraderScore: Result with score=1.0 if predicted best answer matches ground truth
         """
         # Handle None case for mutable arguments
-        answers = answers if answers is not None else []
-        chosen_indices = chosen_indices if chosen_indices is not None else []
+        if not answers:
+            answers = []
+        if not chosen_indices:
+            chosen_indices = []
 
         # Ensure we have exactly 4 answers
         if len(answers) < 4:
@@ -402,8 +404,10 @@ async def _evaluate_ties(
             GraderScore: Result with score=1.0 if any top-rated answer is in chosen_indices
         """
         # Handle None case for mutable arguments
-        answers = answers if answers is not None else []
-        chosen_indices = chosen_indices if chosen_indices is not None else []
+        if not answers:
+            answers = []
+        if not chosen_indices:
+            chosen_indices = []
 
         correct_indices = set(chosen_indices)