We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 766a896 commit afe96e8Copy full SHA for afe96e8
examples/gpu/llm/fine-tuning/Phi3/README.md
@@ -130,6 +130,7 @@ Example: Phi-3 Mini 4k LoRA fine-tuning.
130
131
132
```bash
133
+export OCL_ICD_VENDORS=/etc/OpenCL/vendors
134
export CCL_PROCESS_LAUNCHER=none
135
export TORCH_LLM_ALLREDUCE=1
136
@@ -158,6 +159,7 @@ Example: Phi3-Mini 4k LoRA fine-tuning.
158
159
160
161
162
163
164
165
@@ -183,3 +185,4 @@ accelerate launch --config_file "fsdp_config.yaml" phi3_ft.py \
183
185
184
186
187
188
+
0 commit comments