This document is relevant for: Inf1, Inf2, Trn1, Trn1n

PyTorch Neuron

PyTorch Neuron unlocks high-performance and cost-effective deep learning acceleration on AWS Trainium-based and Inferentia-based Amazon EC2 instances.

PyTorch Neuron plugin architecture enables native PyTorch models to be accelerated on Neuron devices, so you can use your existing framework application and get started easily with minimal code changes.

Note

For help selecting a framework type for Inference, see:

Comparison of torch-neuron (Inf1) versus torch-neuronx (Inf2 & Trn1) for Inference

PyTorch NeuronX for Inference on Inf2 & Trn1 / Trn1n

PyTorch Neuron for Inference on Inf1

PyTorch NeuronX for Training on Trn1 / Trn1n

This document is relevant for: Inf1, Inf2, Trn1, Trn1n