This document is relevant for: Inf2, Trn1, Trn1n

Developer Guide (torch-neuronx)

Developer Guide for Inference (torch-neuronx)

• NeuronCore Allocation and Model Placement for Inference (torch-neuronx)

• Comparison of Traced Inference versus XLA Lazy Tensor Inference (torch-neuronx)

This document is relevant for: Inf2, Trn1, Trn1n