File tree Expand file tree Collapse file tree 1 file changed +5
-4
lines changed Expand file tree Collapse file tree 1 file changed +5
-4
lines changed Original file line number Diff line number Diff line change 39
39
40
40
41
41
## 新闻
42
- 🔥🔥 [ 2023/09/27 ] 开源了[ CodeFuse-QWen-14B] ( https://huggingface.co/codefuse-ai/CodeFuse-QWen-14B ) 模型,在HumanEval pass@1(greedy decoding)上可以达到48.8%。相比较与基座模型Qwen-14b提升16%。
42
+ 🔥🔥 [ 2023/10/20 ] 开源了[ CodeFuse-QWen-14B] ( https://huggingface.co/codefuse-ai/CodeFuse-QWen-14B ) 模型,在HumanEval pass@1(greedy decoding)上可以达到48.8%。相比较与基座模型Qwen-14b提升16%。
43
43
44
44
🔥🔥 [ 2023/09/27] 开源了[ CodeFuse-StarCoder-15B] ( https://huggingface.co/codefuse-ai/CodeFuse-StarCoder-15B ) 模型,在HumanEval pass@1(greedy decoding)上可以达到54.9%。
45
45
53
53
| 模型 | HumanEval(Pass@1) | 日期 |
54
54
| :----------------------------| :-----------------:| :-------:|
55
55
| ** CodeFuse-CodeLlama-34B** | ** 74.4%** | 2023/09 |
56
- | ** CodeFuse-CodeLlama-34B-4bits** | ** 73.8%** | 2023/09 |
57
- | ** CodeFuse-StarCoder-15B** | ** 54.9%** | 2023/08 |
56
+ | ** CodeFuse-CodeLlama-34B-4bits** | ** 73.8%** | 2023/09 |
58
57
| WizardCoder-Python-34B-V1.0 | 73.2% | 2023/08 |
59
58
| GPT-4(zero-shot) | 67.0% | 2023/03 |
60
59
| PanGu-Coder2 15B | 61.6% | 2023/08 |
60
+ | ** CodeFuse-StarCoder-15B** | ** 54.9%** | 2023/08 |
61
61
| CodeLlama-34b-Python | 53.7% | 2023/08 |
62
+ | ** CodeFuse-QWen-14B** | ** 48.8%** | 2023/10 |
62
63
| CodeLlama-34b | 48.8% | 2023/08 |
63
64
| GPT-3.5(zero-shot) | 48.1% | 2022/11 |
64
65
| OctoCoder | 46.2% | 2023/08 |
65
66
| StarCoder-15B | 33.6% | 2023/05 |
66
- | LLaMA 2 70B(zero-shot) | 29.9 % | 2023/07 |
67
+ | QWen-14B | 32.3 % | 2023/10 |
67
68
68
69
69
70
## 文章
You can’t perform that action at this time.
0 commit comments