v2.0.0

What's Changed

• add image rule guide by @pekopoke in #237
• fix:Layout Prompt by @chaserRen in #239
• add new prompt by @dt-yy in #241
• Fix/ade/dev by @decrystal in #243
• feat: add 5 RAG eval metrics by @e06084 in #244
• feat: support sql datasouce multi-column eval by @shijinpjlab in #259
• feat: sql by @shijinpjlab in #260
• feat: xinghe: md、example、rule by @shijinpjlab in #262
• refactor: multi-turn dialog by @seancoding-day in #264
• feat: update readme by @shijinpjlab in #265
• docs: update architecture pic by @e06084 in #266
• feat: label QUALITY_GOOD by @shijinpjlab in #267
• fix: rag metric by @e06084 in #269
• fix: fix rag example by @e06084 in #270
• feat: add rag mock and eval by @e06084 in #271
• Dev lld: update 5 metrics and dataset for rags by @pekopoke in #273
• fix: rags of 5 metrics by @pekopoke in #276
• fix : embedding model change by @pekopoke in #277
• docs: update wechat by @e06084 in #279
• feat: gradio by @shijinpjlab in #280
• feat: fix by @shijinpjlab in #281
• feat: merge main by @shijinpjlab in #282
• feat: update modelres by @shijinpjlab in #278
• fix: fix rag example by @e06084 in #283
• feat: ci check import by @shijinpjlab in #285
• feat: add score summary by @e06084 in #286
• Feature/ats keyword matcher and resume optimizer by @Kylie-dot-s in #284
• feat: summary support multi-column by @e06084 in #287
• fix: fix ut by @e06084 in #288
• feat: update auto-gen-metric by @e06084 in #289
• feat: update rag_eval_baseline by @e06084 in #290
• feat: update e2e RAG eval by @e06084 in #292
• feat: add PII detetction by @e06084 in #293
• feat: add LLMTextQualityV5 by @e06084 in #294
• fix : update answer_relevancy metric by @pekopoke in #291
• docs: update metrics docs by @e06084 in #295
• docs: update wechat doc by @e06084 in #297
• docs: update README by @e06084 in #298
• docs: update README by @e06084 in #299
• docs: update README by @e06084 in #300
• build: set numpy>=1.26.4 by @e06084 in #301
• feat: update gradio to v2.0 by @shijinpjlab in #302
• feat: update embedding model init by @e06084 in #303
• feat: support excel by @shijinpjlab in #305
• feat: fix bug gradio detail repeat by @shijinpjlab in #306
• feat: unshare link by @shijinpjlab in #307
• feat: update gradio image in readme, add limit of label in gradio by @shijinpjlab in #308
• fix: fix embedding config load by @e06084 in #309
• Fix/docs and examples cleanup by @Kylie-dot-s in #296
• feat: support csv by @shijinpjlab in #310
• feat: add Instruction Quality Evaluation by @e06084 in #313
• feat: add examples in metrics by @e06084 in #314
• feat: init agent&tool architecture by @seancoding-day in #311
• docs: update wechat by @e06084 in #315
• feat: fix spark by @shijinpjlab in #316
• feat:front page V2.0 by @tenwanft in #318
• feat: support parquet file by @shijinpjlab in #320
• Fix/docs only by @Kylie-dot-s in #321
• feat: use_browser by @shijinpjlab in #323
• Feat/update all examples and tests by @Kylie-dot-s in #322
• feat: agent&tool docs/tests/examples by @seancoding-day in #319
• docs: update wechat doc by @shijinpjlab in #324
• feat: update v2.0.0 by @shijinpjlab in #325

New Contributors

• @decrystal made their first contribution in #243
• @tenwanft made their first contribution in #318

Full Changelog: v1.11.1...v2.0.0

v1.11.1

What's Changed

• docs: update wechat by @e06084 in #240
• docs: update wechat by @e06084 in #245
• feat: update wechat img by @e06084 in #249
• feat: update wechat by @e06084 in #261
• docs: update wechat by @e06084 in #268
• feat: openai version free by @shijinpjlab in #274

Full Changelog: v1.11.0...v1.11.1

v1.11.0

What's Changed

• docs: fix artimuse example link; polish Tuiwen.md by @Kylie-dot-s in #164
• docs: update readme with seo meta by @e06084 in #174
• docs: update readme with Trust Score badage by @e06084 in #175
• feat: new config by @shijinpjlab in #177
• docs: update wechat pic by @e06084 in #180
• docs: update wechat pic by @e06084 in #183
• fix: fix Hallucination eval by @e06084 in #186
• fix: fix Hallucination docs by @e06084 in #187
• feat：Add Document Parse Quality Prompt for MinerU training dataset by @chaserRen in #185
• Add xyz audio and format rules by @chaserRen in #189
• feat: 3h eval with reason result by @e06084 in #191
• docs: add artimuse x and reddit post by @e06084 in #192
• docs: update wechat by @e06084 in #196
• feat: vsl add multi dir by @e06084 in #195
• feat: local file support gz by @e06084 in #197
• feat: add factcheck example by @e06084 in #198
• feat: update ModelRes and add img rule by @shijinpjlab in #200
• docs: update wechat pic by @e06084 in #201
• feat: 优化webkit抽取效果对比prompt by @1041206149 in #203
• update document parser by @chaserRen in #207
• feat: add html_extract_compare_v2 by @e06084 in #208
• feat: add parameters for rule by @shijinpjlab in #209
• feat: add all_labels in config by @seancoding-day in #210
• feat: fix s3 source and add example by @e06084 in #211
• feat: add code & table compare prompt by @1041206149 in #213
• docs: update wechat pic by @e06084 in #214
• feat: QUALITY_BAD_IMG_RELEVANCE example by @shijinpjlab in #216
• feat: update metric doc by @e06084 in #219
• feat: update gradio by @shijinpjlab in #218
• add check for overlap label image by @pekopoke in #212
• add label image check guide doc by @pekopoke in #222
• feat: 1. add VLM explanation; 2. update image format in messages; 3. update image dataset by @seancoding-day in #221
• Add Doc Parse Doc by @chaserRen in #224
• add mineru OCR prompt by @dt-yy in #220
• add layout prompt & docs by @chaserRen in #226
• feat: fix RuleUnsafeWords by @shijinpjlab in #229
• docs: update wechat pic by @e06084 in #231
• feat: Add resume quality detection with complete three-layer architecture by @Kylie-dot-s in #230
• fix: resolve packaging dependency conflict by @Kylie-dot-s in #232
• feat: v1.11 by @shijinpjlab in #233
• fix: maintain consistency in prompt instructions by @chaserRen in #234
• feat: metrics doc by @shijinpjlab in #238
• v1.11.0 by @shijinpjlab in #236

Full Changelog: v1.10.0...v1.11.0

v1.10.0

What's Changed

• docs: add 1.9.0 post by @e06084 in #140
• feat: add GPT-5 Hallucinations eval（no Web search） by @e06084 in #143
• MCP Trust Score by @Matvey-Kuk in #144
• feat: add image artimuse by @shijinpjlab in #145
• fix: rule_config key_list load in subprocessor by @e06084 in #147
• docs: add github star click gif by @e06084 in #148
• feat: add meta-rater model-based evaluations by @seancoding-day in #149
• feat: update clickstar gif by @shijinpjlab in #150
• sync main to dev by @e06084 in #152
• feat: add math formula comparison (LLMMathCompare) by @1041206149 in #151
• feat: update gradio demo by @shijinpjlab in #154
• docs: update wechat pic by @e06084 in #155
• docs: update wechat pic by @e06084 in #156
• docs: update CONTRIBUTING docs by @e06084 in #159
• Update vsl.py by @Kylie-dot-s in #158
• feat: 添加artimuse抽样测试集 by @shijinpjlab in #160
• docs(artimuse): align with code; add sample reproduction and description by @Kylie-dot-s in #163
• docs: update wechat pic by @e06084 in #166
• Fix Issue #165: Status of PromptTextHelpful always be bad by @sakunkun in #168
• docs: update wechat pic by @e06084 in #170
• sync dev to main by @e06084 in #171
• Sync main to dev by @e06084 in #169
• feat: v1.10.0 by @shijinpjlab in #172
• v1.10.0 by @shijinpjlab in #173

New Contributors

• @Matvey-Kuk made their first contribution in #144
• @1041206149 made their first contribution in #151
• @Kylie-dot-s made their first contribution in #158
• @sakunkun made their first contribution in #168

Full Changelog: v1.9.0...v1.10.0

v1.9.0

What's Changed

• add long video prompt by @chaserRen in #124
• feat: add hallucination detection with GPT and HHEM-2.1-Open by @e06084 in #126
• update zhihu posts by @seanpjlab in #130
• Add _metric_info by @chaserRen in #131
• feat: merge some rules in one type by @shijinpjlab in #132
• feat: InputArgs update by @shijinpjlab in #133
• feat: 1. Standardize dataman class name 2. update README.md: delete changelog and add deepwiki badge by @seanpjlab in #134
• feat: v1.9 by @shijinpjlab in #135
• v1.9 by @shijinpjlab in #136
• feat: delete example in ci by @shijinpjlab in #138

Full Changelog: v1.8.1...v1.9.0

v1.8.1

What's Changed

• feat: add pkg version by @shijinpjlab in #112
• feat: git publish ci dependency by @shijinpjlab in #113
• feat: add technical doc by @shijinpjlab in #115
• feat: fix lint by @shijinpjlab in #116
• feat: add auto metrics gen method by @e06084 in #114
• update technical doc and extend terminal args compatibility by @shijinpjlab in #117
• docs: add posts doc by @e06084 in #118
• docs: update posts doc by @e06084 in #119
• feat: add app and web-static in wheel package by @shijinpjlab in #121
• feat: gradio add new function by @shijinpjlab in #123
• feat: gradio提示、httpx 版本 by @shijinpjlab in #125
• feat: v1.8.1 by @shijinpjlab in #127
• v1.8.1 by @shijinpjlab in #128

Full Changelog: v1.8...v1.8.1

v1.8

What's Changed

• fix lint. by @shijinpjlab in #103
• Merge rule and prompt Result Info. by @shijinpjlab in #104
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #105
• doc: update architeture by @e06084 in #109
• build: add publish-to-pypi ci and release v1.8 by @e06084 in #110
• Release v1.8 by @e06084 in #111

Full Changelog: v1.7.1...v1.8

v1.7.1

What's Changed

• Main to dev by @e06084 in #77
• feat: add more mcp tools and mcp demo by @seanpjlab in #78
• update mcp readme by @seanpjlab in #79
• feat: add wechat by @e06084 in #80
• docs: update readme by @e06084 in #83
• update fasttext download by @shijinpjlab in #82
• docs: update readme by @e06084 in #84
• optimize: change MetaData to Data by @seanpjlab in #85
• docs: add Japanese readme by @e06084 in #86
• Dev continue by @shijinpjlab in #87
• feat: v1.7 by @shijinpjlab in #88
• feat: llm and rule both in use by @shijinpjlab in #93
• feature: add google colab demo by @e06084 in #95
• feat: pre-commit add flake8 by @e06084 in #96
• feat: raise gradio error in web page and move app_gradio place in project. by @shijinpjlab in #97
• feat: update readme by @shijinpjlab in #98
• fix gardio bug. by @shijinpjlab in #100
• feat: v1.7.1 by @shijinpjlab in #101
• v1.7.1 by @shijinpjlab in #102

Full Changelog: v1.7...v1.7.1

v1.7.0

What's Changed

• Add MseeP.ai badge by @lwsinclair in #75
• fix: update MseeP.ai Security Assessment Badge by @e06084 in #76
• release v1.7 by @shijinpjlab in #89

New Contributors

• @lwsinclair made their first contribution in #75

Full Changelog: v1.6.0...v1.7

v1.6.0

What's Changed

• feat: use repr() to explain the meaning of char. by @shijinpjlab in #55
• feat: update spark exec. by @shijinpjlab in #56
• feat: add llm core use and example. by @shijinpjlab in #57
• feat: update huggingface demo. by @shijinpjlab in #58
• feat: change huggingface demo default values of datasource and rule list by @shijinpjlab in #59
• docs: update readme by @e06084 in #60
• feat: change prompt file name and update readme by @shijinpjlab in #61
• feat: change llm api from call_api to eval by @shijinpjlab in #62
• Update the way of saving data. by @shijinpjlab in #63
• feat: fix base function of ExecProto. And update summarize of spark. by @shijinpjlab in #64
• support DataMan methodology by @seanpjlab in #67
• feat: change llm scene name and add default prompt. by @shijinpjlab in #68
• feat: update readme and fix cli start web by @shijinpjlab in #70
• Support the Dingo MCP server by @seanpjlab in #71
• feat: add use_browser and change args action to store_true by @shijinpjlab in #72
• feat: release v1.6 by @shijinpjlab in #73
• Release v1.6 by @shijinpjlab in #74

Full Changelog: https://github.com/DataEval/dingo/commits/v1.6.0