This document is relevant for: Inf2
, Trn1
, Trn2
Training Tutorials#
Training GPT-NeoX 6.9B with Tensor Parallelism and ZeRO-1 Optimizer
Training GPT-NeoX 20B with Tensor Parallelism and ZeRO-1 Optimizer
Training Llama3.1-8B, Llama3-8B and Llama2-7B with Tensor Parallelism and ZeRO-1 Optimizer
Fine-tuning Llama2 7B with tensor parallelism and ZeRO-1 optimizer using Neuron PyTorch-Lightning
Fine-tuning Llama3 8B with tensor parallelism and LoRA using Neuron PyTorch-Lightning
This document is relevant for: Inf2
, Trn1
, Trn2