Skip to content

Commit d9ee87d

Browse files
authored
Merge pull request #11 from future-agi/bug/import
[Fix] Remove unused import
2 parents 107b00a + d5c877a commit d9ee87d

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

73 files changed

+12381
-3395
lines changed

.gitignore

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -57,3 +57,7 @@ output/
5757
**/.env
5858
*.DS_Store
5959
*.pdf
60+
61+
# typescript
62+
node_modules/
63+
package-lock.json

CHANGELOG.md

Lines changed: 74 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,74 @@
1+
# Changelog
2+
3+
All notable changes to this project will be documented in this file.
4+
5+
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
6+
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
7+
8+
9+
## [0.2.2] - 2025-10-27
10+
11+
- Introducing LLM As A Judge
12+
- Heuristics for JSON, Similarity, String, and Aggregation metrics
13+
- Minor Bug Fixes
14+
15+
## [0.2.1] - 2025-10-9
16+
17+
### Python
18+
#### Added
19+
- Support for batch evaluation
20+
- New evaluation templates for bias detection
21+
- Improved error handling and logging
22+
23+
#### Fixed
24+
- Issue with context adherence evaluation
25+
- Memory leak in long-running evaluations
26+
27+
## [0.1.5] - 2025-10-01
28+
29+
### TypeScript
30+
#### Added
31+
- Initial TypeScript SDK release
32+
- Core evaluation functionality
33+
- Support for all evaluation templates
34+
- ESM and CommonJS module support
35+
36+
### Python
37+
#### Added
38+
- Initial Python SDK release
39+
- 50+ evaluation templates across multiple categories
40+
- Support for RAG, Safety, Function Calling, and Summarization evaluations
41+
- Integration with Future AGI platform
42+
- Batch evaluation support
43+
44+
#### Features
45+
- **RAG Evaluations**: groundedness, context_adherence, answer_relevance
46+
- **Safety**: content_moderation, prompt_injection, harmful_advice detection
47+
- **Function Calling**: JSON validation, schema validation
48+
- **Summarization**: quality assessment, factual consistency
49+
- **Behavioral**: tone analysis, helpfulness, politeness
50+
- **Metrics**: ROUGE, embedding similarity, fuzzy matching
51+
52+
---
53+
54+
## Release Notes Format
55+
56+
### Types of Changes
57+
- `Added` for new features
58+
- `Changed` for changes in existing functionality
59+
- `Deprecated` for soon-to-be removed features
60+
- `Removed` for now removed features
61+
- `Fixed` for any bug fixes
62+
- `Security` in case of vulnerabilities
63+
64+
### Versioning
65+
- **Major version (X.0.0)**: Breaking changes
66+
- **Minor version (0.X.0)**: New features, backward compatible
67+
- **Patch version (0.0.X)**: Bug fixes, backward compatible
68+
69+
---
70+
71+
[Unreleased]: https://github.com/future-agi/ai-evaluation/compare/v0.2.2...HEAD
72+
[0.2.2]: https://github.com/future-agi/ai-evaluation/compare/v0.2.1...v0.2.2
73+
[0.2.1]: https://github.com/future-agi/ai-evaluation/compare/v0.1.0...v0.2.1
74+
[0.1.0]: https://github.com/future-agi/ai-evaluation/releases/tag/v0.1.0

CONTRIBUTING.md

Lines changed: 38 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,38 @@
1+
# Contributing to AI-Evaluation
2+
3+
Thanks for your interest in contributing! 🎉
4+
5+
## Quick Start
6+
7+
```bash
8+
# Fork and clone
9+
git clone https://github.com/YOUR_USERNAME/ai-evaluation.git
10+
11+
# Python
12+
cd python && poetry install && poetry run pytest
13+
14+
# TypeScript
15+
cd typescript/ai-evaluation && pnpm install && pnpm test
16+
```
17+
18+
## How to Contribute
19+
20+
1. **Report bugs** - Open an issue with details
21+
2. **Suggest features** - Describe your use case
22+
3. **Submit PRs** - Fork, create a branch, test your changes
23+
4. **Improve docs** - Fix typos, add examples
24+
25+
## Guidelines
26+
27+
- Write tests for new features
28+
- Follow existing code style
29+
- Update documentation
30+
- Be respectful and constructive
31+
32+
## Questions?
33+
34+
Open a [Discussion](https://github.com/future-agi/ai-evaluation/discussions) or reach out at opensource@futureagi.com
35+
36+
---
37+
38+
By contributing, you agree that your contributions will be licensed under GPL-3.0.

0 commit comments

Comments
 (0)