This document is relevant for: Inf1, Inf2, Trn1, Trn2

Neuron Features

Neuron features provide insights into Neuron capabilities that enable high-performance and improve usability of developing and deploying deep learning acceleration on top of Inferentia and Trainium based instances.

Data types

Neuron rounding modes

Neuron batching

NeuronCore pipeline

Neuron persistent cache

Neuron collective communication

Logical NeuronCore configuration

Neuron custom C++ operators

This document is relevant for: Inf1, Inf2, Trn1, Trn2