Skip to content

Commit 8a98e5a

Browse files
authored
Refactor/push datasets to hub (#60)
1 parent 75efc06 commit 8a98e5a

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

61 files changed

+2
-323153
lines changed

autointent/context/data_handler/_dataset.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -161,14 +161,14 @@ def to_multilabel(self) -> Self:
161161
self[split_name] = split.map(self._to_multilabel)
162162
return self
163163

164-
def push_to_hub(self, repo_id: str) -> None:
164+
def push_to_hub(self, repo_id: str, private: bool = False) -> None:
165165
"""
166166
Push dataset splits to a Hugging Face repository.
167167
168168
:param repo_id: ID of the Hugging Face repository.
169169
"""
170170
for split_name, split in self.items():
171-
split.push_to_hub(repo_id, split=split_name)
171+
split.push_to_hub(repo_id, split=split_name, private=private)
172172

173173
if self.intents:
174174
intents = HFDataset.from_list([intent.model_dump() for intent in self.intents])

data/ac_robotic_2_raw.json

Lines changed: 0 additions & 448 deletions
This file was deleted.

data/autopilot_intents.json

Lines changed: 0 additions & 448 deletions
This file was deleted.

data/banking77_info.json

Lines changed: 0 additions & 1 deletion
This file was deleted.

0 commit comments

Comments
 (0)