Setup Guide

This section walks you through the various options to install and upgrade Neuron. You have to install Neuron on Trainium and Inferentia powered instances to enable deep-learning acceleration.

Launching Inf/Trn instances on Amazon EC2

PyTorch NeuronX (torch-neuronx) Setup for Inf2 & Trn1 / Trn1n/ Trn2 Instances

PyTorch Neuron (torch-neuron) Setup for Inf1 Instances

JAX Setup for Inf2 & Trn1 / Trn1n Instances

Tensorflow Neuron (tensorflow-neuronx) Setup for Inf2 & Trn1 / Trn1n Instances

Tensorflow Neuron (tensorflow-neuron) Setup for Inf1 Instances

MxNet Neuron (mxnet-neuron) Setup for Inf1 Instances

PyTorch Neuron Setup Guides for Rocky Linux 9 (Inf2 & Trn1 / Trn1n) Instances