Fix image curation tutorial batch sizes for typical GPUs (#1050)

* Initial plan

* Fix image tutorial batch sizes for typical GPUs - reduce from 500 to 32

Co-authored-by: VibhuJawa <[email protected]>

* Move batch size note up and enhance with specific GPU guidance

Co-authored-by: VibhuJawa <[email protected]>

* Update tutorials/image/getting-started/README.md

Signed-off-by: Vibhu Jawa <[email protected]>

---------

Signed-off-by: Vibhu Jawa <[email protected]>
Co-authored-by: copilot-swe-agent[bot] <[email protected]>
Co-authored-by: VibhuJawa <[email protected]>
Co-authored-by: Vibhu Jawa <[email protected]>

Author: Copilot

tutorials/image/getting-started/README.md

@@ -47,6 +47,10 @@ python -c "from huggingface_hub import snapshot_download; snapshot_download('ttj
 
 ### Run the scripts
 
+**Note on Batch Sizes:** The batch sizes used in both workflows below are conservative limits set for typical GPUs with 24-48 GB of VRAM (e.g., RTX 4090, A6000, RTX A5000). You can tune these based on your available GPU memory:
+- **High-memory GPUs (80 GB+)** like H100, B200, or A100 80GB: Increase batch sizes for better performance (e.g., `--task-batch-size 500 --embedding-batch-size 500 --aesthetic-batch-size 500 --nsfw-batch-size 500`)
+- **Lower-memory GPUs (16 GB or less)**: Reduce batch sizes further (e.g., `--task-batch-size 16 --embedding-batch-size 16`)
+
 Run the image curation pipeline on GPUs (extracting embeddings, NSFW and aesthetics scores, filtering based on thresholds):
 
 ```bash
@@ -56,10 +60,10 @@ python tutorials/image/getting-started/image_curation_example.py \
     --output-dataset-dir ./example_data/results_truncated_100k_mscoco \
     --model-dir ./model_weights \
     --tar-files-per-partition 10 \
-    --task-batch-size 500 \
-    --embedding-batch-size 500 \
-    --aesthetic-batch-size 500 \
-    --nsfw-batch-size 500 \
+    --task-batch-size 32 \
+    --embedding-batch-size 32 \
+    --aesthetic-batch-size 32 \
+    --nsfw-batch-size 32 \
     --aesthetic-threshold 0.9 \
     --nsfw-threshold 0.9 \
     --images-per-tar 1000 \
@@ -75,8 +79,8 @@ python tutorials/image/getting-started/image_dedup_example.py \
     --embeddings-dir ./example_data/dedup/embeddings/truncated_100k_mscoco \
     --removal-parquets-dir ./example_data/dedup/removal_ids/truncated_100k_mscoco \
     --model-dir ./model_weights \
-    --task-batch-size 1000 \
-    --embedding-batch-size 500 \
+    --task-batch-size 32 \
+    --embedding-batch-size 32 \
     --tar-files-per-partition 10 \
     --skip-download \
     --verbose