.. _neuron-architecture-index: Neuron Architecture =================== The Neuron Architecture provides insights into Neuron enabled instances system, software and chip capabilities. The EC2 Trn and Inf instance architecture provides an overview of the EC2 instances powered by the Inferentia and Trainium chips (Neuron Devices), and the corresponding system features like inbox and network connectivity, memory hierarchy, and NeuronCores versions and capabilities. The Neuron model architecture fit provides insights to what is the best match between deep-learning model architectures and the NeuronCore version. .. contents:: Table of contents :local: :depth: 1 Trn and Inf instances --------------------- .. grid:: 2 .. card:: EC2 Trn1/Trn1n Architecture :link: aws-trn1-arch :link-type: ref :class-body: sphinx-design-class-title-small .. card:: EC2 Inf2 Architecture :link: aws-inf2-arch :link-type: ref :class-body: sphinx-design-class-title-small .. card:: EC2 Inf1 Architecture :link: aws-inf1-arch :link-type: ref :class-body: sphinx-design-class-title-small Trainium and Inferentia devices ------------------------------- .. grid:: 2 .. card:: AWS Trainium Architecture :link: trainium-arch :link-type: ref :class-body: sphinx-design-class-title-small .. card:: AWS Inferentia2 Architecture :link: inferentia2-arch :link-type: ref :class-body: sphinx-design-class-title-small .. card:: AWS Inferentia Architecture :link: inferentia-arch :link-type: ref :class-body: sphinx-design-class-title-small NeuronCores ----------- .. grid:: 2 .. card:: NeuronCore-v1 :link: neuroncores-v1-arch :link-type: ref :class-body: sphinx-design-class-title-small .. card:: NeuronCore-v2 :link: neuroncores-v2-arch :link-type: ref :class-body: sphinx-design-class-title-small Neuron Model Architecture ------------------------- .. grid:: 2 .. card:: Neuron Model Architecture Fit Guidelines :link: model_architecture_fit :link-type: ref :class-body: sphinx-design-class-title-small Other ----- .. grid:: 2 .. card:: Neuron Glossary :link: neuron_hw_glossary :link-type: ref :class-body: sphinx-design-class-title-small .. toctree:: :maxdepth: 1 :hidden: /general/arch/neuron-hardware/inf1-arch /general/arch/neuron-hardware/trn1-arch /general/arch/neuron-hardware/inf2-arch /general/arch/neuron-hardware/inferentia /general/arch/neuron-hardware/inferentia2 /general/arch/neuron-hardware/trainium /general/arch/neuron-hardware/neuroncores-arch Neuron Model Architecture Fit Guidelines Neuron Glossary