This document is relevant for: Inf2, Trn1, Trn1n

PyTorch Neuron (torch-neuronx) Setup#

Note

This Setup guide is relevant for Inf2 & Trn1 / Trn1n instances.

torch-neuronx setup on Ubuntu 20#

Ubuntu 20 (Ubuntu20 AMI)
Ubuntu 20 (DLAMI Base AMI)
Ubuntu 20 (DLAMI PyTorch Neuron)

torch-neuronx setup on Ubuntu 22#

Ubuntu 22 (Ubuntu22 AMI)

torch-neuronx setup on Amazon Linux 2 (AL2)#

Amazon Linux 2 (Amazon Linux 2 AMI)
Amazon Linux 2 (DLAMI Base AMI)
Amazon Linux 2 (DLAMI PyTorch Neuron)

torch-neuronx setup on Amazon Linux 2023 (AL2023)#

Amazon Linux 2023 (Amazon Linux 2023 AMI)

This document is relevant for: Inf2, Trn1, Trn1n