This document is relevant for: Trn2, Trn3

TorchNeuron tutorials#

End-to-end walk-throughs on AWS Trainium that build on the quickstarts. Each tutorial produces a working, realistic use case.

Simple training loop on Neuron tutorial

A complete, copy-paste training loop in eager mode and optional torch.compile.

Distributed training with torch.distributed tutorial

Scale a training job across multiple NeuronCores and nodes using FSDP, DTensor, and DDP.

Hugging Face inference with torch.compile tutorial

Compile Hugging Face generate() with torch.compile and the neuron backend, and compile a model that is sharded across NeuronCores.

This document is relevant for: Trn2, Trn3