This document is relevant for: Inf1, Inf2, Trn1, Trn2

AWS NeuronCore Architecture

NeuronCores are fully-independent heterogenous compute-units that power Tranium, Tranium2, Inferentia, and Inferentia2 chips. For a detailed description of current generation NeuronCore (NeuronCore-v3) hardware engines, see:

• NeuronCore-v3 Architecture

For more information about previous generation NeuronCores, see:

• NeuronCore-v2 Architecture

• NeuronCore-v1 Architecture

This document is relevant for: Inf1, Inf2, Trn1, Trn2