This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Neuron Application Notes

Neuron 2.x

• Introducing first release of Neuron 2.x enabling EC2 Trn1 general availability (GA)

Neuron Runtime library

• Introducing Neuron Runtime 2.x (libnrt.so)

Performance (Inf1)

• Performance Tuning
• Parallel Execution using NEURON_RT_NUM_CORES

PyTorch Neuron (torch-neuron)

• Running R-CNNs on Inf1

Transformers Neuron (transformers-neuronx)

• Generative LLM inference with Neuron

This document is relevant for: Inf1, Inf2, Trn1, Trn1n