Merge pull request #69 from NYU-RTS/usability_datasets

s-sajid-ali · web-flow · commit db0ff8b80c09 · 2025-03-25T11:06:44.000-04:00
Usability of datasets section
diff --git a/docs/hpc/04_datasets/01_intro.md b/docs/hpc/04_datasets/01_intro.md
@@ -161,5 +161,8 @@ The Pile is a 825 GiB diverse, open source language modeling data set that consi
 The field of machine learning is changing rapidly. Waymo is in a unique position to contribute to the research community with 	some of the largest and most diverse autonomous driving datasets ever released.
 
 *Dataset is available under*
+-   `/vast/work/public/ml-datasets/waymo_open_dataset_scene_flow`
 -   `/vast/work/public/ml-datasets/waymo_open_dataset_v_1_2_0_individual_files`
+-   `/vast/work/public/ml-datasets/waymo_open_dataset_v_1_3_2_individual_files`
+-   `/vast/work/public/ml-datasets/waymo_open_dataset_v_1_4_1_individual_files`
 
diff --git a/docs/hpc/04_datasets/02_squash_file_system_and_singularity.md b/docs/hpc/04_datasets/02_squash_file_system_and_singularity.md
diff --git a/docs/hpc/04_datasets/02_working_with_datasets.md b/docs/hpc/04_datasets/02_working_with_datasets.md
@@ -0,0 +1,3 @@
+# Working with Datasets
+
+Please see the [Squash File System and Singularity page](../07_containers/04_squash_file_system_and_singularity.md) in the [Containers section](../07_containers/01_intro.md) for details about working with datasets on the clusters.

Original file line number	Diff line number	Diff line change
`@@ -0,0 +1,3 @@`
	`1`	`+# Working with Datasets`
	`2`	`+`
	`3`	`+Please see the [Squash File System and Singularity page](../07_containers/04_squash_file_system_and_singularity.md) in the [Containers section](../07_containers/01_intro.md) for details about working with datasets on the clusters.`