Skip to content

Commit 089e168

Browse files
committed
add instructions for local_docker orch
1 parent 89beb69 commit 089e168

File tree

2 files changed

+14
-0
lines changed

2 files changed

+14
-0
lines changed

huggingface-sagemaker/README.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -101,6 +101,18 @@ make install-stack
101101
zenml stack hf-sagekamer-local
102102
```
103103

104+
Additionally, if you're using the local Docker orchestrator, you'll need to create a cache directory for the datasets and ensure it has the correct permissions:
105+
106+
```shell
107+
# Create cache directory at project root
108+
mkdir -p cache/datasets
109+
110+
# Set permissions to allow read/write access
111+
chmod -R 777 cache
112+
```
113+
114+
This directory will be mounted into the Docker container and used as a cache for the Hugging Face datasets.
115+
104116
</details>
105117

106118
<details>

huggingface-sagemaker/configs/trainer_config.yaml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -39,6 +39,8 @@ settings:
3939
memory: "14Gi"
4040
cpu: "6"
4141

42+
# you should have a cache/datasets folder in your local machine
43+
# for this mount to work.
4244
orchestrator.local_docker:
4345
run_args:
4446
volumes:

0 commit comments

Comments
 (0)