This document is relevant for: Trn1, Trn2, Trn3

Tutorials for Training(torch-neuronx)

• Hugging Face BERT Pretraining Tutorial (Data-Parallel)

• Multi-Layer Perceptron Training Tutorial

• PyTorch Neuron for Trainium Hugging Face BERT MRPC task finetuning using Hugging Face Trainer API

• Fine-tune T5 model on Trn1

• ZeRO-1 Tutorial

• Analyze for Training Tutorial

• Neuron Custom C++ Operators in MLP Training

• Neuron Custom C++ Operators Performance Optimization

Note

To use Jupyter Notebook see:

• Jupyter Notebook QuickStart

• Running Jupyter Notebook as script

This document is relevant for: Trn1, Trn2, Trn3