This document is relevant for: Inf1, Trn1

Neuron Architecture#

The Neuron Archtecture provides insights into Neuron enabled instances system, software and chip capabilities. The EC2 Trn1 and Inf1 instance architecture provides an overview of the EC2 instances powered by the Inferentia and Trainium chips (Neuron Devices), and the corresponding system features like inbox and network connectivity, memory hierarchy, and NeuronCores versions and capabilities. The Neuron model architecture fit provides insights to what is the best match between deep-learning model architectures and the NeuronCore version.

EC2 Inf1 Architecture
EC2 Trn1 Architecture
AWS NeuronCore Architecture
Neuron Model Architecture Fit Guidelines
Neuron Glossary

This document is relevant for: Inf1, Trn1