[BUG] OSError: [Errno 22] Invalid argument

[blap]

Describe the bug

'--save-details' try to save details in 'C:/Users/Admin/Desktop/Python/0.LLMs/lighteval/results/details/HuggingFaceTB-SmolLM2-135M-Instruct-cache/2025-03-21T03-10-00.577563/details_leaderboard|hellaswag|0_202
5-03-21T03-10-00.577563.parquet' causing the error 'OSError: [Errno 22] Invalid argument'

This kind of error usually arises from issues such as Incorrect File Path. Certain characters in the path, like |, may be invalid for filenames in Windows. You'll need to remove or replace them with acceptable characters.

To Reproduce

Just use '--save-details' in a Windows enviroment.

Expected behavior

'--save-details' option save details.

Version info

Windows 10, lighteval 0.7.0.

[NathanHB]

hi ! We do not support windows in lighteval for now, but you can open a PR to change the file naming. closing for now

[ljvmiranda921]

I think this error also shows up in a Linux system.

[NathanHB]

there is a PR fixing this, we are going to merge it soon !