You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, MaxText uses a few dependencies, such as `mlperf-logging` and `google-jetstream`, that are installed directly from GitHub source. These are defined in `base_requirements/requirements.txt`, and the `seed-env` tool will carry them over to the generated requirements files.
135
135
136
-
## 5. Verify the New Dependencies
136
+
## Step 5: Verify the New Dependencies
137
137
138
138
Finally, test that the new dependencies install correctly and that MaxText runs as expected.
3.**Run tests:** Run MaxText tests to ensure there are no regressions.
158
+
3.**Run tests:** Run MaxText tests to ensure there are no regressions.
159
+
160
+
## Appendix: Install XPK for Multi-host Workloads
161
+
162
+
XPK (Accelerated Processing Kit) is a tool designed to simplify the orchestration and management of workloads on Google Kubernetes Engine (GKE) clusters with TPU or GPU accelerators. In MaxText, we use XPK to submit both pre-training and post-training jobs on multi-host TPU configurations.
163
+
164
+
For your convenience, we provide a minimal installation path below:
165
+
```bash
166
+
# Directly install xpk using pip
167
+
pip install xpk
168
+
169
+
# Install kubectl
170
+
sudo apt-get update
171
+
sudo apt install snapd
172
+
sudo snap install kubectl --classic
173
+
174
+
# Install gke-gcloud-auth-plugin
175
+
echo"deb [signed-by=/usr/share/keyrings/cloud.google.gpg] https://packages.cloud.google.com/apt cloud-sdk main"| sudo tee -a /etc/apt/sources.list.d/google-cloud-sdk.list
0 commit comments