-
Notifications
You must be signed in to change notification settings - Fork 148
environments acpt pytorch 2.2 cuda12.1
Recommended environment for Deep Learning in public preview with PyTorch on Azure containing the Azure ML SDK with the latest compatible versions of Ubuntu, Python, PyTorch, CUDA\RocM, combined with optimizers like ORT Training,+DeepSpeed+MSCCL+ORT MoE and more. The image introduces newly released PyTorch 2.1 for early testing, and preview of new fastcheckpointing capability called Nebula. Azure Container Registry:acptdev.azurecr.io/test/public/aifx/acpt/stable-ubuntu2004-cu121-py310-torch212
Version: 40
PyTorch : 2.2
GPU : Cuda12
OS : Ubuntu20.04
Training
Preview
Python : 3.10
DeepSpeed : 0.13.1
ONNXRuntime : 1.17.1
torch_ORT : 1.17.0
Checkpointing:Nebula : 0.16.10
View in Studio: https://ml.azure.com/registries/azureml/environments/acpt-pytorch-2.2-cuda12.1/version/40
Docker image: mcr.microsoft.com/azureml/curated/acpt-pytorch-2.2-cuda12.1:40
FROM mcr.microsoft.com/aifx/acpt/stable-ubuntu2204-cu118-py310-torch271:biweekly.202508.1
# Install pip dependencies
COPY requirements.txt .
RUN pip install -r requirements.txt --no-cache-dir
# Upgrade known vulnerable packages again just to be safe
RUN pip install --upgrade \
requests==2.32.4 \
urllib3==2.5.0 \
pillow==11.3.0 || true
# Repeat for other envs if applicable
RUN /opt/conda/bin/pip install --upgrade \
requests==2.32.4 \
urllib3==2.5.0 \
pillow==11.3.0 || true
RUN /opt/conda/envs/ptca/bin/pip install --upgrade \
requests==2.32.4 \
urllib3==2.5.0 \
pillow==11.3.0 || true
# Inference requirements
COPY --from=mcr.microsoft.com/azureml/o16n-base/python-assets:20230419.v1 /artifacts /var/
RUN apt-get update && \
apt-get install -y --no-install-recommends \
libcurl4 \
liblttng-ust1 \
libunwind8 \
libxml++2.6-2v5 \
nginx-light \
psmisc \
rsyslog \
runit \
unzip && \
apt-get clean && rm -rf /var/lib/apt/lists/* && \
cp /var/configuration/rsyslog.conf /etc/rsyslog.conf && \
cp /var/configuration/nginx.conf /etc/nginx/sites-available/app && \
ln -sf /etc/nginx/sites-available/app /etc/nginx/sites-enabled/app && \
rm -f /etc/nginx/sites-enabled/default
RUN apt-get update && \
apt-get install -y --only-upgrade \
libpython3.10-stdlib \
python3.10 \
libpython3.10-minimal \
python3.10-minimal \
libpam0g \
libpam-modules-bin \
libpam-modules \
libpam-runtime \
sudo && \
apt-get clean && rm -rf /var/lib/apt/lists/*
ENV SVDIR=/var/runit
ENV WORKER_TIMEOUT=400
EXPOSE 5001 8883 8888
# support Deepspeed launcher requirement of passwordless ssh login
RUN apt-get update
RUN apt-get install -y openssh-server openssh-client