How can I use my own dataset?

[preetu10]

Hello. I want to use my own dataset with GraphAgent. Can you kindly tell me which files I need to change for this?

[yuh-yang]

Hi,

Please refer to GraphAGent-training/debug_prepare_data.py and GraphAGent-training/dataloaders/nlp_rw_dataloader.py and the dataset on HF: https://huggingface.co/datasets/GraphAgent/GraphAgent-Datasets/tree/main/NLP_related_work/instruction
for the data format. Please strictly follow the data format shown in our datasets to formulate your own data.

Once it is done, you can use nlp_rw_dataloader.py to load your own dataset and hack the whole training process. :)