This document is relevant for: Inf2, Trn1, Trn1n

Developer Guide (torch-neuronx)

Developer Guide for Inference (torch-neuronx)

• NeuronCore Allocation and Model Placement for Inference (torch-neuronx)

• Comparison of Traced Inference versus XLA Lazy Tensor Inference (torch-neuronx)

• Data Parallel Inference on torch_neuronx

• Autobucketing for Inference (|torch-neuronx|)

This document is relevant for: Inf2, Trn1, Trn1n