v0.1

What's Changed

• Dev by @aJupyter in #3
• ADD run_qwen.bash by @aJupyter in #4
• feat: add zhipuai_gen_data by @aJupyter in #5
• Dev by @aJupyter in #6
• FIX bugs @aJupyter by @aJupyter in #7
• Dev by @aJupyter in #8
• feat: finetune Qwen and demo by @jujimeizuo in #11
• add data_process by @8baby8 in #12
• refactor: modified xtuner_config and removed model_config by @aJupyter in #13
• feat: add datasets and update readme by @aJupyter in #14
• zhouxinao by @zxazys in #19
• readme English version by @JasonLLLLLLLLLLL in #20
• New dataset by @MrCatAI in #21
• Upload datasets by @MING-ZCH in #22
• Upload multi_turn_dataset by @MING-ZCH in #23
• add evaluation part by @ZeyuBa in #24
• upload multi_turn_dataset by @MING-ZCH in #25
• Add files via upload by @8baby8 in #26
• Modifying Ocr Scripts by @8baby8 in #28
• test by @8baby8 in #29
• Add files via upload by @zxazys in #27
• Update Readme.md by @MING-ZCH in #31
• update REAEME.md for both language by @aiyinyuedejustin in #32
• Update README.md by @8baby8 in #33
• Restructure the evaluation by @MING-ZCH in #34
• add InterLM2_7B eval by @ZeyuBa in #35
• add SoulStar_data.json by @Nobody-ML in #36
• Update README and README_English_version by @Nobody-ML in #37
• [Update] README files translation by @chg0901 in #40
• Dev by @aJupyter in #41
• add InternLM2_7B_chat_full eval by @ZeyuBa in #44
• [DOC] Update docs in evaluate folder by @MING-ZCH in #45
• [DOC] Rename General_evaluation.md by @MING-ZCH in #46
• [DOC] Add Introduction of datasets and update Roadmap by @MING-ZCH in #47
• [DOC] Update docs of evaluation by @MING-ZCH in #48
• [DOC] Create README_EN of datasets.md by @MING-ZCH in #49
• [DOC] Update system_prompt of qa_generation by @MING-ZCH in #50
• [docs] add lmdeploy.md by @Nobody-ML in #51
• Add concurrent functions (#1) by @Anooyman in #52
• [DOC] Update README by @Anooyman in #53
• 新增ENmd文档 by @Vicky-3021 in #55
• [DOC] Update README.md in datasets by @MING-ZCH in #56
• Update multi QA generation process by @Anooyman in #54
• [docs] update lmdeploy file by @Nobody-ML in #57
• Merge dev by @aJupyter in #58
• add Ocr.md by @8baby8 in #59
• [DOC] Fix bugs in docs by @MING-ZCH in #60
• [DOC] Update EmoLLM V2.0’s evaluation details and fix some bugs in docs by @MING-ZCH in #61
• [DOC] add ocr.md by @aJupyter in #62
• update personal info and small format optimizations by @chg0901 in #63
• Dev by @aJupyter in #64
• update personal info and translations for contents in a table by @chg0901 in #65
• Update RAG README by @santiagoTOP in #66
• Dev by @aJupyter in #67
• Update demo link in README.md by @chg0901 in #68
• add bitex by @chg0901 in #71
• Update README_EN.md with xlab demo links by @chg0901 in #73
• Add RAG README.md by @Anooyman in #72
• Dev by @aJupyter in #78
• Update ChatGLM3-6b-ft.md by @chg0901 in #75
• Update ChatGLM3-6b-ft_EN.md by @chg0901 in #79
• update qwen, zhipuai gen_data and readme by @chg0901 in #80
• Update zhipuai_gen_data.py 修改遍历顺序， 先遍历领域area再遍历心情emotions by @chg0901 in #83
• Update qwen_gen_data_NoBash.py 修改遍历顺序， 先遍历领域area再遍历心情emotions by @chg0901 in #82
• Dev by @aJupyter in #85
• merge clean_qa by @aJupyter in #86
• Clean qa by @wwwyfff in #81
• Update zhipuai_gen_data.py 修改生成的数量 by @chg0901 in #87
• Update qwen_gen_data_NoBash.py 修改生成数量和保存间隔 by @chg0901 in #88
• RAG module update by @Anooyman in #91
• Update qwen_gen_data_NoBash.py 添加对qwen-max的异常处理 by @chg0901 in #90
• Dev by @aJupyter in #92
• update README.md and README_EN.md by @zealot52099 in #93
• Update RAG README by @santiagoTOP in #94
• Update tutorial.md update part 5 and 6 by @chg0901 in #95
• optimizing the merge_json.py + moving files +Update zhipuai_gen_data.py 添加glm-4 response获取异常处理 by @chg0901 in #89
• 框架图 by @zxazys in #96
• 添加框架图 by @aJupyter in #97
• Update three merge_json*.py files and corresponding tutorial in CN and EN by @chg0901 in #98
• update README by @wwwyfff in #99
• update by @zealot52099 in #100
• update readme by @jkhumor in #102
• add deduplicate.py by @zealot52099 in #103
• GLM-6B ft by @wwwyfff in #104
• update deduplicate.py by @zealot52099 in #105
• update RAG pipeline by @Anooyman in #106
• Dev by @aJupyter in #107
• update rag/src/data_processing.py & main,py by @zealot52099 in #108
• [DOC] Update README.md by @MING-ZCH in #109
• Dev by @aJupyter in #110
• update deduplicate.py by @zealot52099 in #112
• scientist.json by @lll997150986 in #113
• Dev by @aJupyter in #114
• [Update] modified and add files related to fintuning with internlm2_7b_base by @chg0901 in #116
• [DOC]update datesets/README.md by @zealot52099 in #115
• Dev by @aJupyter in #117
• Dev (#117) by @aJupyter in #118
• Dev (#117) (#118) by @aJupyter in #119
• Update RAG pipeline by @Anooyman in #120
• update rag/src/data_processing.py by @zealot52099 in #121
• [Code] update rag by @aJupyter in #122
• update rag/src/data_processing.py & rag/src/config/config.py by @zealot52099 in #123
• Add files via upload by @brycewang2018 in #127
• add base model qlora fintuning config file and optimize deduplicate.py by @chg0901 in #128
• Dev by @aJupyter in #129
• 加入微调README.md 以及相关文件 by @zealot52099 in #130
• Dev by @aJupyter in #131
• [DOC]README_scientist.md by @zealot52099 in #132
• Dev by @aJupyter in #133
• add README_Model_Uploading.md and images by @chg0901 in #134
• Dev by @aJupyter in #135
• update model uploading with openxlab by @chg0901 in #136
• Dev by @aJupyter in #137
• update xtuner_config\README_internlm2_7b_base_qlora.md by @chg0901 in #138
• Updata RAG by @Anooyman in #140
• Dev by @aJupyter in #141
• 数据库 by @nln-maker in #143
• Dev by @aJupyter in #144
• 更新了微信小程序原型设计部分 by @dream00001 in #145
• 更新了readme by @nln-maker in #146
• Revert "readme" by @aJupyter in #147
• Merge Dev by @aJupyter in #148
• [DOC] update readme by @aJupyter in #149
• feat: add agents/actions/write_markdown by @jujimeizuo in #152
• Update RAG pipeline by @Anooyman in #153
• Dev by @aJupyter in #154
• [ADD] add evaluation result of base model on 5/10 epochs by @ZeyuBa in #155
• [Merge] dev by @aJupyter in #157
• Mother 数据集更新 by @brycewang2018 in #158
• [Dataset] Merge Dev by @aJupyter in #159
• update mpi4py installation by @chg0901 in #162
• [DOC] update README by @zealot52099 in #161
• [Merge] Dev by @aJupyter in #163
• Update README.md by @brycewang2018 in #164
• 多轮对话母亲角色的微调脚本 by @brycewang2018 in #165
• [Merge] Dev by @aJupyter in #166
• 中英文版本 readme 的更新 by @brycewang2018 in #167
• [DOC] Update readme by @aJupyter in #168
• Update readme by @Yicooong in #169
• [Doc] update readme by @aJupyter in #170
• [Doc] Update readme by @aJupyter in #171
• [DOC] Update README.md in datasets and evaluate by @MING-ZCH in #172
• [merge] merge new docs from dev bench by @MING-ZCH in #173
• Upload mother dataset by @MING-ZCH in #174
• [Merge] Merge datasets from Dev bench by @MING-ZCH in #175
• [Doc] Update README_EN.md by @eltociear in #176
• InternLM2-Base-7B QLoRA微调模型 链接和测评结果更新 by @chg0901 in #178
• [Doc] update evalutaion result by @aJupyter in #179
• 新增模型下载脚本，修改本地部署文档 by @HatBoy in #180
• Dev by @aJupyter in #181
• 消除图片黑边，增加作者信息 by @Yicooong in #182
• Dev by @aJupyter in #183
• update model config file links by @chg0901 in #184
• Create internlm2_20b_chat_lora_alpaca_e3.py，20b模型的配置文件 by @zxazys in #185
• Dev by @aJupyter in #186
• update model config file links by @chg0901 in #188
• Revert "update model config file links" by @chg0901 in #189
• [redo] update model config file links 20b by @chg0901 in #190
• Fix the bug that openxlab platform cannot be deployed. by @HatBoy in #187
• [Merge] Dev by @aJupyter in #193
• Add RAG into EmoLLM by @Anooyman in #191
• Baby EmoLLM by @santiagoTOP in #194
• [Merge] Dev by @aJupyter in #195
• upload llama3 qlora config files by @chg0901 in #201
• [Merge] Dev by @aJupyter in #202
• 自我认知数据集和处理代码 by @chg0901 in #203
• Dev by @aJupyter in #204
• 更新git-lfs conda安装方法 by @chg0901 in #205
• cli_Llama3-8B-Instruct by @chg0901 in #206
• web_demo-Llama3_online by @chg0901 in #207
• Dev by @chg0901 in #208
• [DOC] Update README.md in dataset by @MING-ZCH in #210
• [Merge] Dev by @MING-ZCH in #211
• update llama3 webdemo by @chg0901 in #212
• update model table in main readme and download_model.py by @chg0901 in #213
• update port num by @chg0901 in #214
• create web_demo-Llama3.py and update, not use online flag and model_path para by @chg0901 in #215
• 更新二维码 and by @chg0901 in #216
• Dev by @chg0901 in #217
• 去除meta-gpt, 安装websockets==11.0.3 by @chg0901 in #218
• update llama webdemo、还原 requirements、add ModelScope link for /chg0901/EmoLLM-Llama3-8B-Instruct2.0 by @chg0901 in #219
• [Merge] Dev by @aJupyter in #220
• 处理之前根据心理学数据生成的QA数据 by @wwwyfff in #221
• [Merge] Dev by @aJupyter in #222
• add xtuner2sharegpt.py by @zealot52099 in #223
• Dev by @aJupyter in #224
• Update README_Model_Uploading.md by @chg0901 in #226
• Ruozhiba data and processing codes by @chg0901 in #227
• llama3 3.0 config by @chg0901 in #228
• 添加了pdf2md的脚本 by @626394316 in #225
• Update pipeline.py 修改import 文件路径 by @chg0901 in #229
• Dev by @chg0901 in #231
• [DOC] Update README.md by @MING-ZCH in #233
• Dev by @MING-ZCH in #234
• add Incremental Pre-training Guide by @aJupyter in #235
• Update llama3 web demo and tutorials by @chg0901 in #232
• Dev by @chg0901 in #236
• [DOC] Update README.md by @MING-ZCH in #238
• Dev by @MING-ZCH in #239
• update daddy-like bf in readme with gradio web demo by @chg0901 in #240
• [DOC] Update README.md by @MING-ZCH in #241
• Dev by @MING-ZCH in #242
• [DOC] Update README.md by @MING-ZCH in #247
• Dev by @MING-ZCH in #248

New Contributors

• @8baby8 made their first contribution in #12
• @zxazys made their first contribution in #19
• @JasonLLLLLLLLLLL made their first contribution in #20
• @MrCatAI made their first contribution in #21
• @MING-ZCH made their first contribution in #22
• @ZeyuBa made their first contribution in #24
• @aiyinyuedejustin made their first contribution in #32
• @Nobody-ML made their first contribution in #36
• @Anooyman made their first contribution in #52
• @Vicky-3021 made their first contribution in #55
• @santiagoTOP made their first contribution in #66
• @zealot52099 made their first contribution in #93
• @jkhumor made their first contribution in #102
• @lll997150986 made their first contribution in #113
• @brycewang2018 made their first contribution in #127
• @nln-maker made their first contribution in #143
• @dream00001 made their first contribution in #145
• @Yicooong made their first contribution in #169
• @eltociear made their first contribution in #176
• @HatBoy made their first contribution in #180
• @626394316 made their first contribution in #225

Full Changelog: https://github.com/SmartFlowAI/EmoLLM/commits/v0.1