Skip to content

WorkArena L3 evaluation never stops running #323

@lakshya-skyfall

Description

@lakshya-skyfall

I experimented running main.py for workarena_l3_agent_curriculum_eval ("workarena_l3" throws an error so I changed the name to this) with different n_jobs to speed up evaluation going from 2 to 6 and n_relaunch=1, however the evaluation never stops running even after leaving it to run for 3 days. Do you know why this is happening and how it can be fixed?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions