This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Inference

Note

For help selecting a framework type, see:

Comparison of torch-neuron (Inf1) versus torch-neuronx (Inf2 & Trn1) for Inference

Inference on Inf2 & Trn1/Trn1n

PyTorch Neuron(torch-neuronx) for Inference

Inference on Inf1

PyTorch Neuron(torch-neuron) for Inference

This document is relevant for: Inf1, Inf2, Trn1, Trn1n