This document is relevant for: Trn1, Trn2

Tutorials (torch-neuronx)

• Hugging Face BERT Pretraining Tutorial (Data-Parallel)
• Multi-Layer Perceptron Training Tutorial
• PyTorch Neuron for Trainium Hugging Face BERT MRPC task finetuning using Hugging Face Trainer API
• ZeRO-1 Tutorial
• Analyze for Training Tutorial
• Neuron Custom C++ Operators in MLP Training
• Neuron Custom C++ Operators Performance Optimization

This document is relevant for: Trn1, Trn2