HumanEval+ v0.1.10

HumanEval+ v0.1.10

HumanEval+ v0.1.9

HumanEval+ dataset, revision v0.1.9:

• HumanEvalPlus-OriginFmt.jsonl.gz: The (compressed) HumanEval+ dataset that follows the original HumanEval format and is designed to be compatible with existing evaluation frameworks targetting the original HumanEval.
• HumanEvalPlus.jsonl.gz: The (compressed) HumanEval+ dataset that follows the EvalPlus format and is designed to be used by the evalplus framework.
• HumanEvalPlus-Mini.jsonl.gz: HumanEvalPlus.jsonl.gz with fewer test-cases yet achieving similar effectiveness.

See also https://huggingface.co/datasets/evalplus/humanevalplus