This document is relevant for: Inf1, Inf2, Trn1, Trn2

Release Content#

Neuron 2.22.0 (04/03/2025)#

Trn1 packages #

List of packages in Neuron 2.22.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.24.59.0 
Driver                              aws-neuronx-dkms-2.20.28.0 
CustomOps                           aws-neuronx-gpsimd-customop-lib-0.14.12.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.14.6.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.24.23.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.24.23.0 
OCI                                 aws-neuronx-oci-hook-2.7.5.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.24.53.0 
System Tools                        aws-neuronx-tools-2.22.61.0 
Jax                                 jax_neuronx-0.1.3 
Framework                           libneuronxla-2.2.1630.0 
Framework                           libneuronxla-0.5.3396 
Compiler                            neuronx-cc-2.17.194.0 
Compiler                            neuronx-cc-stubs-2.17.194.0 
Neuron Distributed                  neuronx_distributed-0.11.0 
Neuron Distributed Training         neuronx_distributed_training-1.2.0 
TensorBoard                         tensorboard-plugin-neuronx-2.6.117.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.12.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.12.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.12.2.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-2.5.1.2.6.0 
PyTorch                             torch_xla-2.1.6 
Transformers Neuron                 transformers-neuronx-0.13.470

Trn2 packages #

List of packages in Neuron 2.22.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.24.59.0 
Driver                              aws-neuronx-dkms-2.20.28.0 
CustomOps                           aws-neuronx-gpsimd-customop-lib-0.14.12.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.14.6.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.24.23.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.24.23.0 
OCI                                 aws-neuronx-oci-hook-2.7.5.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.24.53.0 
System Tools                        aws-neuronx-tools-2.22.61.0 
Compiler                            neuronx-cc-2.17.194.0 
Compiler                            neuronx-cc-stubs-2.17.194.0 
Neuron Distributed                  neuronx_distributed-0.11.0 
Neuron Distributed Inference        neuronx_distributed_inference-0.2.0 
PyTorch                             torch-neuronx-2.5.1.2.6.0 
PyTorch                             torch_xla-2.1.6

Inf2 packages #

List of packages in Neuron 2.22.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.24.59.0 
Driver                              aws-neuronx-dkms-2.20.28.0 
CustomOps                           aws-neuronx-gpsimd-customop-lib-0.14.12.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.14.6.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.24.23.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.24.23.0 
OCI                                 aws-neuronx-oci-hook-2.7.5.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.24.53.0 
System Tools                        aws-neuronx-tools-2.22.61.0 
Jax                                 jax_neuronx-0.1.3 
Framework                           libneuronxla-2.2.1630.0 
Framework                           libneuronxla-0.5.3396 
Compiler                            neuronx-cc-2.17.194.0 
Compiler                            neuronx-cc-stubs-2.17.194.0 
Neuron Distributed                  neuronx_distributed-0.11.0 
Neuron Distributed Inference        neuronx_distributed_inference-0.2.0 
TensorBoard                         tensorboard-plugin-neuronx-2.6.117.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.12.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.12.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.12.2.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-2.5.1.2.6.0 
PyTorch                             torch_xla-2.1.6 
Transformers Neuron                 transformers-neuronx-0.13.470

Inf1 packages #

List of packages in Neuron 2.22.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.24.59.0 
Driver                              aws-neuronx-dkms-2.20.28.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.24.23.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.24.23.0 
OCI                                 aws-neuronx-oci-hook-2.7.5.0 
Runtime Library                     aws-neuronx-runtime-lib-2.24.53.0 
System Tools                        aws-neuronx-tools-2.22.61.0 
Compiler                            dmlc_nnvm-1.19.6.0 
Compiler                            dmlc_topi-1.19.6.0 
Compiler                            dmlc_tvm-1.19.6.0 
Compiler                            inferentia_hwm-1.17.6.0 
MXNet                               mx_neuron-1.8.0.2.4.147.0 
MXNet                               mxnet_neuron-1.5.1.1.10.0.0 
Compiler                            neuron-cc-1.24.0.0 
Perf Tools                          neuronperf-1.8.93.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.12.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.12.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.12.2.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.12.2.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.12.2.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.12.2.0 
PyTorch                             torch-neuron-1.13.1.2.11.13.0

Supported Python Versions for Inf1 packages #

List of packages in Neuron 2.22.0:

Package                                        Supported Python Versions              
dmlc_nnvm-1.19.6.0                                3.9, 3.10 
dmlc_topi-1.19.6.0                                3.9, 3.10 
dmlc_tvm-1.19.6.0                                 3.9, 3.10 
inferentia_hwm-1.17.6.0                           3.9, 3.10 
mx_neuron-1.8.0.2.4.147.0                         3.9, 3.10 
mxnet_neuron-1.5.1.1.10.0.0                       3.9, 3.10 
neuron-cc-1.24.0.0                                3.9, 3.10 
neuronperf-1.8.93.0                               3.9, 3.10 
tensorflow-neuron-2.10.1.2.12.2.0                 3.9, 3.10 
tensorflow-neuron-2.8.4.2.12.2.0                  3.9, 3.10 
tensorflow-neuron-2.9.3.2.12.2.0                  3.9, 3.10 
torch-neuron-1.13.1.2.11.13.0                     3.9, 3.10

Supported Python Versions for Inf2/Trn1/Trn2 packages #

List of packages in Neuron 2.22.0:

Package                                        Supported Python Versions              
aws-neuronx-runtime-discovery-2.9                 3.9, 3.10, 3.11 
jax_neuronx-0.1.3                                 3.9 
libneuronxla-2.2.1630.0                           3.9, 3.10, 3.11 
libneuronxla-0.5.3396                             3.9, 3.10 
neuronx-cc-2.17.194.0                             3.9, 3.10, 3.11 
neuronx-cc-stubs-2.17.194.0                       3.9, 3.10 
neuronx_distributed-0.11.0                        3.9, 3.10, 3.11 
neuronx_distributed_inference-0.2.0               3.9, 3.10, 3.11 
tensorflow-neuronx-2.10.1.2.1.0                   3.9, 3.10 
tensorflow-neuronx-2.8.4.2.1.0                    3.9, 3.10 
tensorflow-neuronx-2.9.3.2.1.0                    3.9, 3.10 
torch-neuronx-2.5.1.2.6.0                         3.9, 3.10, 3.11 
torch_xla-2.1.6                                   3.9, 3.10, 3.11 
transformers-neuronx-0.13.470                     3.9, 3.10, 3.11

Supported Numpy Versions #

Neuron supports versions >= 1.21.6 and <= 1.22.2

Supported HuggingFace Transformers Versions #

Package	Supported HuggingFace Transformers Versions
torch-neuronx	< 4.35 and >=4.37.2
transformers-neuronx	>= 4.36.0
neuronx-distributed - Llama model class	4.31
neuronx-distributed - GPT NeoX model class	4.26
neuronx-distributed - Bert model class	4.26
nemo-megatron	4.31.0

Supported Probuf Versions #

Package	Supported Probuf versions
neuronx-cc	> 3
torch-neuronx	>= 3.20
torch-neuron	< 3.20
transformers-neuronx	>= 3.20
neuronx-distributed	>= 3.20
tensorflow-neuronx	< 3.20
tensorflow-neuron	< 3.20

Previous Neuron Releases Content #

This document is relevant for: Inf1, Inf2, Trn1, Trn2

Release Content

Contents

Release Content#