Skip to content

Commit 0c081bf

Browse files
committed
Update llama2-7b image
1 parent 76dec9d commit 0c081bf

File tree

2 files changed

+3
-3
lines changed

2 files changed

+3
-3
lines changed

training/v5p/Llama2-7B-PyTorch/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ This user guide provides a concise overview of the essential steps required to r
55

66
## Environment Setup
77

8-
The following setup assumes to run the training job with llama2-7b on GCE TPUs using the docker image from this registery (`us-central1-docker.pkg.dev/tpu-pytorch/docker/reproducibility/llama2@sha256:3fda2382a36c8a7c39f8838f9a1abde3a161fd47283b052d04fa090e3ee210f5`), the docker image uses the pytorch and torch_xla nightly build from 09/16/2024 and installed with all the package dependency needed to run the model training. Please follow corresponding TPU generation's user guide to setup the GCE TPUs first. All the command below should run from your own machine (not the TPU host you created).
8+
The following setup assumes to run the training job with llama2-7b on GCE TPUs using the docker image from this registery (`us-central1-docker.pkg.dev/deeplearning-images/reproducibility/pytorch-xla/llama2:7b`), the docker image uses the pytorch and torch_xla nightly build from 09/16/2024 and installed with all the package dependency needed to run the model training. Please follow corresponding TPU generation's user guide to setup the GCE TPUs first. All the command below should run from your own machine (not the TPU host you created).
99

1010
### Setup Environment of Your TPUs
1111
Please replace all your-* with your TPUs' information.
@@ -29,7 +29,7 @@ HF_TOKEN=hf_***
2929
3. Edit `host.sh` to add the docker image URL if default docker image is not accessible to you.
3030
```bash
3131
# docker image URL to use for the training
32-
DOCKER_IMAGE=us-central1-docker.pkg.dev/tpu-pytorch/docker/reproducibility/llama2@sha256:3fda2382a36c8a7c39f8838f9a1abde3a161fd47283b052d04fa090e3ee210f5
32+
DOCKER_IMAGE=us-central1-docker.pkg.dev/deeplearning-images/reproducibility/pytorch-xla/llama2:7b
3333
```
3434
4. Run the training script:
3535
```bash

training/v5p/Llama2-7B-PyTorch/host.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
#!/bin/bash
22

3-
DOCKER_IMAGE="us-central1-docker.pkg.dev/tpu-pytorch/docker/reproducibility/llama2@sha256:3fda2382a36c8a7c39f8838f9a1abde3a161fd47283b052d04fa090e3ee210f5"
3+
DOCKER_IMAGE="us-central1-docker.pkg.dev/deeplearning-images/reproducibility/pytorch-xla/llama2:7b"
44

55
worker_id=$(curl -s "http://metadata.google.internal/computeMetadata/v1/instance/attributes/agent-worker-number" -H 'Metadata-Flavor: Google')
66

0 commit comments

Comments
 (0)