Will the code for the zero-shot task evaluation be made public?

[tro0o]

Hello, I would like to replicate the evaluation of the 2-bit llama1-7b model from your work. Could you please release the evaluation code for the zero-shot task? thank you!

[NicoNico6]

Hi @tro0o,

thanks for your interest in this work. We have opened the harness evaluation; you can refer to the low_bit_yi branch for more information.

Additionally, we will soon open source our new version of 2-bit models, and the zero-shot information in README will get updated correspondingly.

[tro0o]

@NicoNico6 Thank you for your response，I look forward to the new version of 2-bit models.