Developer Guide (neuronx-distributed )
This document is relevant for: Inf2
, Trn1
, Trn1n
Developer Guide (neuronx-distributed
)#
Developer guide for Tensor Parallelism (neuronx-distributed )
Developer guide for Pipeline Parallelism (neuronx-distributed )
Developer guide for Activation Memory reduction (neuronx-distributed )
Developer guide for Neuron-PT-Lightning (neuronx-distributed )
Developer guide for model and optimizer wrapper (neuronx-distributed )
Developer guide for save/load checkpoint (neuronx-distributed )
Developer guide for Neuronx-Distributed Inference (neuronx-distributed )
This document is relevant for: Inf2
, Trn1
, Trn1n