Release Action-Sketcher artifacts (models, dataset) on Hugging Face

[NielsRogge]

Hi @tanhuajie 🤗

Niels here from the open-source team at Hugging Face. I discovered your work on Arxiv and was wondering whether you would like to submit it to hf.co/papers to improve its discoverability. If you are one of the authors, you can submit it at https://huggingface.co/papers/submit.

The paper page lets people discuss about your paper and lets them find artifacts about it (your models, datasets or demo for instance), you can also claim the paper as yours which will show up on your public profile at HF, add Github and project page URLs.

I noticed on your GitHub README and project page that you are planning to release the Action-Sketcher model checkpoints and the curated robotics dataset soon. It'd be great to make these available on the 🤗 hub to improve their discoverability and visibility within the AI and robotics community. We can add specific metadata tags (like robotics or vla) so that people find them easily.

Uploading models

See here for a guide: https://huggingface.co/docs/hub/models-uploading.

In this case, we could leverage the PyTorchModelHubMixin class which adds from_pretrained and push_to_hub to any custom nn.Module. Alternatively, one can leverages the hf_hub_download one-liner to download a checkpoint from the hub.

Uploading dataset

Would be awesome to make the dataset available on 🤗 , so that people can do:

from datasets import load_dataset

dataset = load_dataset("FlagOpen/Action-Sketcher-Corpus")

See here for a guide: https://huggingface.co/docs/datasets/loading.

Besides that, there's the dataset viewer which allows people to quickly explore the first few rows of the data and your visual sketches directly in the browser.

I see you already have placeholder links for Hugging Face—that's great! Let me know if you're interested or need any help regarding the process.

Cheers,

Niels
ML Engineer @ HF 🤗