@@ -8,21 +8,21 @@ AWS Neuron Deep Learning Containers (DLCs) are a set of Docker images for traini
88
99| Framework | Neuron Packages | Neuron SDK Version | Supported EC2 Instance Types | Python Version Options | ECR Public URL | Other Packages |
1010| ----------------------------------------------------------------------------------------------------------------------------------------| ---------------------------------| --------------------| ------------------------------| ------------------------| ------------------------------------------------------------------------------------------| -------------------|
11- | [ PyTorch 1.13.1] ( https://github.com/aws-neuron/deep-learning-containers/blob/2.20.1 /docker/pytorch/inference/1.13.1/Dockerfile.neuron ) | aws-neuronx-tools, torch-neuron | Neuron 2.20.1 | inf1 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-inference-neuron:1.13.1-neuron-py310-sdk2.20.1 -ubuntu20.04 | torchserve 0.11.0 |
11+ | [ PyTorch 1.13.1] ( https://github.com/aws-neuron/deep-learning-containers/blob/2.20.2 /docker/pytorch/inference/1.13.1/Dockerfile.neuron ) | aws-neuronx-tools, torch-neuron | Neuron 2.20.2 | inf1 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-inference-neuron:1.13.1-neuron-py310-sdk2.20.2 -ubuntu20.04 | torchserve 0.11.0 |
1212
1313### pytorch-inference-neuronx
1414
1515| Framework | Neuron Packages | Neuron SDK Version | Supported EC2 Instance Types | Python Version Options | ECR Public URL | Other Packages |
1616| -----------------------------------------------------------------------------------------------------------------------------------------| -----------------------------------------------------------------------------| --------------------| ------------------------------| ------------------------| --------------------------------------------------------------------------------------------| -------------------|
17- | [ PyTorch 2.1.2] ( https://github.com/aws-neuron/deep-learning-containers/blob/2.20.1 /docker/pytorch/inference/2.1.2/Dockerfile.neuronx ) | aws-neuronx-tools, neuronx_distributed, torch-neuronx, transformers-neuronx | Neuron 2.20.1 | trn1,inf2 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-inference-neuronx:2.1.2-neuronx-py310-sdk2.20.1 -ubuntu20.04 | torchserve 0.11.0 |
18- | [ PyTorch 1.13.1] ( https://github.com/aws-neuron/deep-learning-containers/blob/2.20.1 /docker/pytorch/inference/1.13.1/Dockerfile.neuronx ) | aws-neuronx-tools, neuronx_distributed, torch-neuronx, transformers-neuronx | Neuron 2.20.1 | trn1,inf2 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-inference-neuronx:1.13.1-neuronx-py310-sdk2.20.1 -ubuntu20.04 | torchserve 0.11.0 |
17+ | [ PyTorch 2.1.2] ( https://github.com/aws-neuron/deep-learning-containers/blob/2.20.2 /docker/pytorch/inference/2.1.2/Dockerfile.neuronx ) | aws-neuronx-tools, neuronx_distributed, torch-neuronx, transformers-neuronx | Neuron 2.20.2 | trn1,inf2 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-inference-neuronx:2.1.2-neuronx-py310-sdk2.20.2 -ubuntu20.04 | torchserve 0.11.0 |
18+ | [ PyTorch 1.13.1] ( https://github.com/aws-neuron/deep-learning-containers/blob/2.20.2 /docker/pytorch/inference/1.13.1/Dockerfile.neuronx ) | aws-neuronx-tools, neuronx_distributed, torch-neuronx, transformers-neuronx | Neuron 2.20.2 | trn1,inf2 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-inference-neuronx:1.13.1-neuronx-py310-sdk2.20.2 -ubuntu20.04 | torchserve 0.11.0 |
1919
2020### pytorch-training-neuronx
2121
2222| Framework | Neuron Packages | Neuron SDK Version | Supported EC2 Instance Types | Python Version Options | ECR Public URL |
2323| ----------------------------------------------------------------------------------------------------------------------------------------| -------------------------------------------------------| --------------------| ------------------------------| ------------------------| -------------------------------------------------------------------------------------------|
24- | [ PyTorch 2.1.2] ( https://github.com/aws-neuron/deep-learning-containers/blob/2.20.1 /docker/pytorch/training/2.1.2/Dockerfile.neuronx ) | aws-neuronx-tools, neuronx_distributed, neuronx_distributed_training, torch-neuronx | Neuron 2.20.1 | trn1,inf2 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-training-neuronx:2.1.2-neuronx-py310-sdk2.20.1 -ubuntu20.04 |
25- | [ PyTorch 1.13.1] ( https://github.com/aws-neuron/deep-learning-containers/blob/2.20.1 /docker/pytorch/training/1.13.1/Dockerfile.neuronx ) | aws-neuronx-tools, neuronx_distributed, neuronx_distributed_training, torch-neuronx | Neuron 2.20.1 | trn1,inf2 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-training-neuronx:1.13.1-neuronx-py310-sdk2.20.1 -ubuntu20.04 |
24+ | [ PyTorch 2.1.2] ( https://github.com/aws-neuron/deep-learning-containers/blob/2.20.2 /docker/pytorch/training/2.1.2/Dockerfile.neuronx ) | aws-neuronx-tools, neuronx_distributed, neuronx_distributed_training, torch-neuronx | Neuron 2.20.2 | trn1,inf2 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-training-neuronx:2.1.2-neuronx-py310-sdk2.20.2 -ubuntu20.04 |
25+ | [ PyTorch 1.13.1] ( https://github.com/aws-neuron/deep-learning-containers/blob/2.20.2 /docker/pytorch/training/1.13.1/Dockerfile.neuronx ) | aws-neuronx-tools, neuronx_distributed, neuronx_distributed_training, torch-neuronx | Neuron 2.20.2 | trn1,inf2 | 3.10 (py310) | public.ecr.aws/neuron/pytorch-training-neuronx:1.13.1-neuronx-py310-sdk2.20.2 -ubuntu20.04 |
2626
2727## Security
2828
0 commit comments