Containers - Locate Neuron DLC Image
This document is relevant for: Inf1, Inf2, Trn1, Trn1n
Containers - Locate Neuron DLC Image#
The Pytorch Neuron DLC images are published to ECR Public, which is the recommended URL to use for most cases. If you are working within AWS SageMaker, you should use the Amazon ECR URL instead of the Amazon ECR Public one because of the restriction of Sagemaker. TensorFlow DLCs are not updated with the latest release. For earlier releases please check here.
Framework |
Neuron Package |
Job Type |
Supported EC2 Instance Types |
Python Version Options |
ECR Public Repo URL |
Image Details |
Other Packages |
|---|---|---|---|---|---|---|---|
PyTorch 2.1.2 |
aws-neuronx-tools, neuronx_distributed, torch-neuronx, transformers-neuronx |
inference |
trn1 and inf2 |
3.10 (py310) |
https://github.com/aws-neuron/deep-learning-containers#pytorch-inference-neuronx |
torchserve |
|
PyTorch 2.1.2 |
aws-neuronx-tools, neuronx_distributed, torch-neuronx |
training |
trn1 and inf2 |
3.10 (py310) |
https://github.com/aws-neuron/deep-learning-containers#pytorch-training-neuronx |
||
PyTorch 1.13.1 |
aws-neuronx-tools, torch-neuron |
inference |
inf1 |
3.10 (py310) |
https://github.com/aws-neuron/deep-learning-containers#pytorch-inference-neuron |
torchserve |
|
PyTorch 1.13.1 |
aws-neuronx-tools, neuronx_distributed, torch-neuronx, transformers-neuronx |
inference |
trn1 and inf2 |
3.10 (py310) |
https://github.com/aws-neuron/deep-learning-containers#pytorch-inference-neuronx |
torchserve |
|
PyTorch 1.13.1 |
aws-neuronx-tools, neuronx_distributed, torch-neuronx |
training |
trn1 and inf2 |
3.10 (py310) |
https://github.com/aws-neuron/deep-learning-containers#pytorch-training-neuronx |
Find latest Neuron DLC images.
In the DLC release page do a search for Neuron to get the ECR repo location of specific Neuron DLC release.
This document is relevant for: Inf1, Inf2, Trn1, Trn1n