This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Pytorch Neuron Setup

Install and configure PyTorch for use with AWS Neuron on Trainium and Inferentia instances.

PyTorch Neuron (torch-neuronx) Setup for Inf2, Trn1, and Trn2 Instances

Install and configure PyTorch NeuronX for Inf2, Trn1, and Trn2 instances.

PyTorch Neuron (torch-neuron) Setup for Inf1 Instances (Archived)

Legacy setup guide for PyTorch Neuron on Inf1 instances. This package has been archived.

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3