This document is relevant for: Inf2, Trn1, Trn2

PyTorch Neuron (torch-neuronx) Setup#

Note

This Setup guide is relevant for Inf2 & Trn1 / Trn1n / Trn2 instances.

torch-neuronx setup on Ubuntu 22#

Ubuntu 22 (Neuron Multi-Framework DLAMI)
Ubuntu 22 (Ubuntu22 AMI)

torch-neuronx setup on Amazon Linux 2023 (AL2023)#

Amazon Linux 2023 (Amazon Linux 2023 AMI)

torch-neuronx setup on Rocky Linux 9#

Rocky Linux 9 (Rocky Linux 9 AMI)

This document is relevant for: Inf2, Trn1, Trn2