-
Notifications
You must be signed in to change notification settings - Fork 0
Description
Hi,
Thank you for your detailed and well-documented open-sourcing of this project. I’m very interested in your work and am currently trying to fully reproduce and follow it.
However, I noticed that the current repository does not include the complete reword_score for verl.utils, when I run bash, it will return error:
from verl.utils.reward_score import gsm8k, math, multiply, countdown, kk, halueval, asqa, hotpot
ImportError: cannot import name 'asqa' from 'verl.utils.reward_score' /FSPO/verl/utils/reward_score/init.py)
In the paper, it seems asqa dataset is not included. Is this dataset not needed? If it is needed, could you provide the corresponding processing file?This would allow me—and others—to more accurately reproduce the results.
Thank you again for your great work! @turboLJY