This document is relevant for: Inf2, Trn1, Trn2, Trn3

Developer Guide (torch-neuronx)

Developer Guide for Inference (torch-neuronx)

• NeuronCore Allocation and Model Placement for Inference (torch-neuronx)

• Comparison of Traced Inference versus XLA Lazy Tensor Inference (torch-neuronx)

• Data Parallel Inference on torch_neuronx

• Autobucketing for Inference (torch-neuronx)

This document is relevant for: Inf2, Trn1, Trn2, Trn3