This document is relevant for: Inf1
, Inf2
, Trn1
, Trn1n
PyTorch Neuron#
PyTorch Neuron unlocks high-performance and cost-effective deep learning acceleration on AWS Trainium-based and Inferentia-based Amazon EC2 instances.
PyTorch Neuron plugin architecture enables native PyTorch models to be accelerated on Neuron devices, so you can use your existing framework application and get started easily with minimal code changes.
Note
For help selecting a framework type for Inference, see:
Comparison of torch-neuron (Inf1) versus torch-neuronx (Inf2 & Trn1) for Inference
This document is relevant for: Inf1
, Inf2
, Trn1
, Trn1n