Skip to content

Commit fa8c226

Browse files
authored
Update README.md
1 parent 3697e8b commit fa8c226

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

README.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,8 @@
4141

4242

4343
## News
44+
🔥🔥🔥 [2023/09/26]We are pleased to announce the release of the 4-bit quantized version of CodeFuse-CodeLlama-34B. Despite the quantization process, the model still achieves a remarkable 73.8% accuracy (greedy decoding) on the HumanEval pass@1 metric.
45+
4446
🔥🔥🔥 [2023/09/07]We released **CodeFuse-CodeLlama-34B**, which achieves the **74.4% Python Pass@1** (greedy decoding) and surpasses GPT4 (2023/03/15) and ChatGPT-3.5 on the [HumanEval Benchmarks](https://github.com/openai/human-eval).
4547

4648
🔥 [2023/08/26]We released MFTCoder which supports finetuning Code Llama, Llama, Llama2, StarCoder, ChatGLM2, CodeGeeX2, Qwen, and GPT-NeoX models with LoRA/QLoRA.
@@ -49,6 +51,7 @@
4951
| Model | HumanEval(Pass@1) | Date |
5052
|:----------------------------|:-----------------:|:-------:|
5153
| **CodeFuse-CodeLlama-34B** | **74.4%** | 2023/09 |
54+
|**CodeFuse-CodeLlama-34B-4bits** | **73.8%** | 2023/09 |
5255
| WizardCoder-Python-34B-V1.0 | 73.2% | 2023/08 |
5356
| GPT-4(zero-shot) | 67.0% | 2023/03 |
5457
| PanGu-Coder2 15B | 61.6% | 2023/08 |
@@ -115,6 +118,7 @@ We are excited to release the following two CodeLLMs trained by MFTCoder, now av
115118
| Model | Base Model | Num of examples trained | Batch Size | Seq Length |
116119
|--------------------------------------------------------------------------------------------|--------------------|-------------------------|------------|------------|
117120
| [🔥🔥🔥 CodeFuse-CodeLlama-34B](https://huggingface.co/codefuse-ai/CodeFuse-CodeLlama-34B) | CodeLlama-34b-Python | 600k | 80 | 4096 |
121+
| [🔥🔥🔥 CodeFuse-CodeLlama-34B-4bits](https://huggingface.co/codefuse-ai/CodeFuse-CodeLlama-34B-4bits) | CodeLlama-34b-Python| | | 4096 |
118122
| [🔥 CodeFuse-13B](https://huggingface.co/codefuse-ai/CodeFuse-13B) | CodeFuse-13B | 66k | 64 | 4096 |
119123

120124

0 commit comments

Comments
 (0)