Skip to content

Commit 9d3710e

Browse files
Update latest cuda image to include training-hub[cuda]
1 parent c4d9186 commit 9d3710e

File tree

3 files changed

+105
-75
lines changed

3 files changed

+105
-75
lines changed

images/runtime/training/py312-cuda128-torch280/Dockerfile

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -82,10 +82,6 @@ RUN micropipenv install -- --no-cache-dir && \
8282
chmod -R g+w /opt/app-root/lib/python3.12/site-packages && \
8383
fix-permissions /opt/app-root -P
8484

85-
# Install Flash Attention
86-
RUN pip install wheel
87-
RUN pip install --no-cache-dir flash-attn==2.8.3 --no-build-isolation
88-
8985
# Upgrade NCCL to a more recent version and add Training Hub NVIDIA dependencies
9086
RUN pip install \
9187
nvidia-nccl-cu12==2.27.3 \

images/runtime/training/py312-cuda128-torch280/Pipfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ bitsandbytes = ">=0.45.3"
2929
liger-kernel = "==0.5.10"
3030
sentencepiece = "<0.3,>=0.1.99"
3131
tokenizers = "==0.21.4"
32-
training-hub = "==0.2.0"
32+
training-hub = {version = "==0.2.0", extras = ["cuda"]}
3333
trl = "==0.21.0"
3434
deepspeed = ">=0.14.3"
3535
async-timeout = "==4.0.3"

images/runtime/training/py312-cuda128-torch280/Pipfile.lock

Lines changed: 104 additions & 70 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)