Neuron performance benchmarks (archived)#

Warning

These benchmark pages are archived and are no longer maintained. They were measured on Inf1, Inf2, and Trn1 instances with components that are retired or legacy, such as TensorFlow Neuron, torch-neuron, transformers-neuronx, PyTorch/XLA, NxD Core, and NxD Training. They do not reflect the performance of the current Neuron stack. For current inference and training, see Inference on Neuron and Training on Neuron.

Inference performance#

Inf2 inference performance

Inference benchmarks for Inf2 instances (Neuron SDK 2.14 through 2.28)

Trn1 inference performance

Inference benchmarks for Trn1 and Trn1n instances

Inf1 inference performance

Inference benchmarks for Inf1 instances (Neuron SDK 2.12 through 2.20)

Training performance#

Trn1 training performance

PyTorch/XLA and NxD Training benchmarks for Trn1 and Trn1n instances (Neuron SDK 2.24 through 2.28)

This document is relevant for: Inf1, Inf2, Trn1

Neuron performance benchmarks (archived)

Contents

Neuron performance benchmarks (archived)#

Inference performance#

Training performance#