This document is relevant for: Inf1, Inf2, Trn1, Trn2

Release Content#

Neuron 2.24.1 (06/30/2025)#

Trn1 packages#

List of packages in Neuron 2.24.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.26.43.0 
Driver                              aws-neuronx-dkms-2.22.2.0 
CustomOps                           aws-neuronx-gpsimd-customop-lib-0.16.2.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.16.1.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.26.7.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.26.7.0 
OCI                                 aws-neuronx-oci-hook-2.10.56.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.26.42.0 
System Tools                        aws-neuronx-tools-2.24.54.0 
Jax                                 jax_neuronx-0.6.0.1.0.1296 
Framework                           libneuronxla-2.2.4410.0 
Compiler                            neuronx-cc-2.19.8089.0 
Compiler                            neuronx-cc-stubs-2.19.8089.0 
Neuron Distributed                  neuronx_distributed-0.13.14393 
Neuron Distributed Training         neuronx_distributed_training-1.4.1 
TensorBoard                         tensorboard-plugin-neuronx-2.0.760.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.12.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.12.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.12.2.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
PyTorch                             torch-neuronx-2.5.1.2.8.6734 
PyTorch                             torch-neuronx-2.6.0.2.8.6734 
PyTorch                             torch-neuronx-2.7.0.2.8.6734 
PyTorch                             torch_xla-2.1.6 
Transformers Neuron                 transformers-neuronx-0.13.985

Trn2 packages#

List of packages in Neuron 2.24.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.26.43.0 
Driver                              aws-neuronx-dkms-2.22.2.0 
CustomOps                           aws-neuronx-gpsimd-customop-lib-0.16.2.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.16.1.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.26.7.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.26.7.0 
OCI                                 aws-neuronx-oci-hook-2.10.56.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.26.42.0 
System Tools                        aws-neuronx-tools-2.24.54.0 
Compiler                            neuronx-cc-2.19.8089.0 
Compiler                            neuronx-cc-stubs-2.19.8089.0 
Neuron Distributed                  neuronx_distributed-0.13.14393 
Neuron Distributed Training         neuronx_distributed_training-1.4.1 
Neuron Distributed Inference        neuronx_distributed_inference-0.4.7422 
PyTorch                             torch-neuronx-2.5.1.2.8.6734 
PyTorch                             torch-neuronx-2.6.0.2.8.6734 
PyTorch                             torch-neuronx-2.7.0.2.8.6734 
PyTorch                             torch_xla-2.1.6

Inf2 packages#

List of packages in Neuron 2.24.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.26.43.0 
Driver                              aws-neuronx-dkms-2.22.2.0 
CustomOps                           aws-neuronx-gpsimd-customop-lib-0.16.2.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.16.1.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.26.7.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.26.7.0 
OCI                                 aws-neuronx-oci-hook-2.10.56.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.26.42.0 
System Tools                        aws-neuronx-tools-2.24.54.0 
Jax                                 jax_neuronx-0.6.0.1.0.1296 
Framework                           libneuronxla-2.2.4410.0 
Compiler                            neuronx-cc-2.19.8089.0 
Compiler                            neuronx-cc-stubs-2.19.8089.0 
Neuron Distributed                  neuronx_distributed-0.13.14393 
Neuron Distributed Inference        neuronx_distributed_inference-0.4.7422 
TensorBoard                         tensorboard-plugin-neuronx-2.0.760.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.12.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.12.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.12.2.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
PyTorch                             torch-neuronx-2.5.1.2.8.6734 
PyTorch                             torch-neuronx-2.6.0.2.8.6734 
PyTorch                             torch-neuronx-2.7.0.2.8.6734 
PyTorch                             torch_xla-2.1.6 
Transformers Neuron                 transformers-neuronx-0.13.985

Inf1 packages#

List of packages in Neuron 2.24.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.26.43.0 
Driver                              aws-neuronx-dkms-2.22.2.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.26.7.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.26.7.0 
OCI                                 aws-neuronx-oci-hook-2.10.56.0 
System Tools                        aws-neuronx-tools-2.24.54.0 
MXNet                               mx_neuron-1.8.0.2.4.147.0 
MXNet                               mxnet_neuron-1.5.1.1.10.0.0 
Compiler                            neuron-cc-1.24.0.0 
Perf Tools                          neuronperf-1.8.93.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.12.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.12.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.12.2.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.12.2.0 
PyTorch                             torch-neuron-1.13.1.2.11.13.0

Supported Python Versions for Inf1 packages#

List of packages in Neuron 2.24.1:

Package                                        Supported Python Versions              
mx_neuron-1.8.0.2.4.147.0                         3.9, 3.10 
mxnet_neuron-1.5.1.1.10.0.0                       3.9, 3.10 
neuron-cc-1.24.0.0                                3.9, 3.10 
neuronperf-1.8.93.0                               3.9, 3.10 
tensorflow-neuron-2.10.1.2.12.2.0                 3.9, 3.10 
torch-neuron-1.13.1.2.11.13.0                     3.9, 3.10

Supported Python Versions for Inf2/Trn1/Trn2 packages#

List of packages in Neuron 2.24.1:

Package                                        Supported Python Versions              
aws-neuronx-runtime-discovery-2.9                 3.9, 3.10, 3.11 
jax_neuronx-0.6.0.1.0.1296                        3.9 
libneuronxla-2.2.4410.0                           3.9, 3.10, 3.11 
neuronx-cc-2.19.8089.0                            3.9, 3.10, 3.11 
neuronx-cc-stubs-2.19.8089.0                      3.9, 3.10 
neuronx_distributed-0.13.14393                    3.9, 3.10, 3.11 
neuronx_distributed_inference-0.4.7422            3.9, 3.10, 3.11 
tensorflow-neuronx-2.10.1.2.1.0                   3.9, 3.10 
torch-neuronx-2.5.1.2.8.6734                      3.9, 3.10, 3.11 
torch-neuronx-2.6.0.2.8.6734                      3.9, 3.10, 3.11 
torch-neuronx-2.7.0.2.8.6734                      3.9, 3.10, 3.11 
torch_xla-2.1.6                                   3.9, 3.10, 3.11 
transformers-neuronx-0.13.985                     3.9, 3.10, 3.11

Supported NumPy Versions#

Neuron supports versions >= 1.21.6 and <= 1.22.2

Supported Hugging Face Transformers Versions#

Package

Supported Hugging Face Transformers Versions

torch-neuronx

< 4.35 and >=4.37.2

transformers-neuronx

>= 4.36.0

neuronx-distributed - Llama model class

4.31

neuronx-distributed - GPT NeoX model class

4.26

neuronx-distributed - Bert model class

4.26

nemo-megatron

4.31.0

Supported Protobuf Versions#

Package

Supported Probuf versions

neuronx-cc

> 3

torch-neuronx

>= 3.20

torch-neuron

< 3.20

transformers-neuronx

>= 3.20

neuronx-distributed

>= 3.20

tensorflow-neuronx

< 3.20

tensorflow-neuron

< 3.20

Previous Neuron Releases Content#

This document is relevant for: Inf1, Inf2, Trn1, Trn2