Skip to content
Greetings

How to shuffle & optimize Hugging Face datasets for LLM pre-training with StreamingDataset ? #1228

Sign in to view logs

How to shuffle & optimize Hugging Face datasets for LLM pre-training with StreamingDataset ?

How to shuffle & optimize Hugging Face datasets for LLM pre-training with StreamingDataset ? #1228

Triggered via issue August 22, 2025 15:32
@pietrolescipietrolesci
labeled #696 42cbc98
Status Success
Total duration 7s
Artifacts –

greetings.yml

on: issues
greeting
3s
greeting
Fit to window
Zoom out
Zoom in

Annotations

1 warning
greeting
Unexpected input(s) 'repo-token', 'issue-message', 'pr-message', valid inputs are ['issue_message', 'pr_message', 'repo_token']