This document is relevant for: Inf1, Inf2, Trn1, Trn2

Amazon EC2 AI Chips Architecture

Amazon EC2 AI Chips (Neuron Devices) are the accelerated machine learning chips (e.g. Inferentia or Trainium) that enable Trn and Inf instance.

For a detailed description of current Neuron chips:

• Trainium2 Architecture

• Trainium Architecture

• Inferentia2 Architecture

• Inferentia Architecture

This document is relevant for: Inf1, Inf2, Trn1, Trn2