Skip to content

Request for missing file #4

@coderpracticer

Description

@coderpracticer

Hi,

Thank you for your detailed and well-documented open-sourcing of this project. I’m very interested in your work and am currently trying to fully reproduce and follow it.

However, I noticed that the current repository does not include the complete reword_score for verl.utils, when I run bash, it will return error:

from verl.utils.reward_score import gsm8k, math, multiply, countdown, kk, halueval, asqa, hotpot
ImportError: cannot import name 'asqa' from 'verl.utils.reward_score' /FSPO/verl/utils/reward_score/init.py)

In the paper, it seems asqa dataset is not included. Is this dataset not needed? If it is needed, could you provide the corresponding processing file?This would allow me—and others—to more accurately reproduce the results.

Thank you again for your great work! @turboLJY

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions