This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Previous Releases Artifacts (Neuron 2.x)

Neuron 2.18.0 (04/01/2024)

Trn1 packages

List of packages in Neuron 2.18.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.20.22.0 
Driver                              aws-neuronx-dkms-2.16.7.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.9.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.9.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.20.13.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.20.13.0 
OCI                                 aws-neuronx-oci-hook-2.3.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.20.22.0 
System Tools                        aws-neuronx-tools-2.17.1.0 
Framework                           libneuronxla-2.0.965 
Framework                           libneuronxla-0.5.971 
Compiler                            neuronx-cc-2.13.66.0 
Neuron Distributed                  neuronx_distributed-0.7.0 
TensorBoard                         tensorboard-plugin-neuronx-2.6.7.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.19.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.19.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.19.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.19.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-1.13.1.1.14.0 
PyTorch                             torch-neuronx-2.1.2.2.1.0 
PyTorch                             torch_xla-1.13.1+torchneurone 
PyTorch                             torch_xla-2.1.2 
Transformers Neuron                 transformers-neuronx-0.10.0.21

Inf2 packages

List of packages in Neuron 2.18.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.20.22.0 
Driver                              aws-neuronx-dkms-2.16.7.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.9.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.9.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.20.13.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.20.13.0 
OCI                                 aws-neuronx-oci-hook-2.3.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.20.22.0 
System Tools                        aws-neuronx-tools-2.17.1.0 
Framework                           libneuronxla-2.0.965 
Framework                           libneuronxla-0.5.971 
Compiler                            neuronx-cc-2.13.66.0 
Neuron Distributed                  neuronx_distributed-0.7.0 
TensorBoard                         tensorboard-plugin-neuronx-2.6.7.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.19.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.19.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.19.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.19.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-1.13.1.1.14.0 
PyTorch                             torch-neuronx-2.1.2.2.1.0 
PyTorch                             torch_xla-1.13.1+torchneurone 
PyTorch                             torch_xla-2.1.2 
Transformers Neuron                 transformers-neuronx-0.10.0.21

Inf1 packages

List of packages in Neuron 2.18.0:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.16.7.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.20.13.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.20.13.0 
OCI                                 aws-neuronx-oci-hook-2.3.0.0 
System Tools                        aws-neuronx-tools-2.17.1.0 
Compiler                            dmlc_nnvm-1.19.0.0 
Compiler                            dmlc_topi-1.19.0.0 
Compiler                            dmlc_tvm-1.19.0.0 
Compiler                            inferentia_hwm-1.17.0.0 
MXNet                               mx_neuron-1.8.0.2.4.50.0 
MXNet                               mxnet_neuron-1.5.1.1.10.0.0 
Compiler                            neuron-cc-1.22.0.0 
Perf Tools                          neuronperf-1.8.55.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.19.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.19.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.19.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.19.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.10.19.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.10.19.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.10.19.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.10.19.0 
PyTorch                             torch-neuron-1.10.2.2.9.74.0 
PyTorch                             torch-neuron-1.11.0.2.9.74.0 
PyTorch                             torch-neuron-1.12.1.2.9.74.0 
PyTorch                             torch-neuron-1.13.1.2.9.74.0 
PyTorch                             torch-neuron-1.9.1.2.9.74.0

Neuron 2.17.0 (02/13/2024)

Trn1 packages

List of packages in Neuron 2.17.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.20.11.0 
Driver                              aws-neuronx-dkms-2.15.9.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.9.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.9.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.19.16.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.19.16.0 
OCI                                 aws-neuronx-oci-hook-2.2.45.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.20.11.0 
System Tools                        aws-neuronx-tools-2.17.0.0 
Framework                           libneuronxla-2.0.755 
Framework                           libneuronxla-0.5.809 
Compiler                            neuronx-cc-2.12.68.0 
Neuron Distributed                  neuronx_distributed-0.6.0 
Compiler                            neuronx_hwm-2.12.0.0 
TensorBoard                         tensorboard-plugin-neuronx-2.6.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.8.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-1.13.1.1.13.1 
PyTorch                             torch-neuronx-2.0.0.2.0.1b0 
PyTorch                             torch-neuronx-2.1.1.2.0.1b0 
PyTorch                             torch_xla-1.13.1+torchneurond 
PyTorch                             torch_xla-2.1.1 
Transformers Neuron                 transformers-neuronx-0.9.474

Inf2 packages

List of packages in Neuron 2.17.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.20.11.0 
Driver                              aws-neuronx-dkms-2.15.9.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.9.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.9.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.19.16.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.19.16.0 
OCI                                 aws-neuronx-oci-hook-2.2.45.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.20.11.0 
System Tools                        aws-neuronx-tools-2.17.0.0 
Framework                           libneuronxla-2.0.755 
Framework                           libneuronxla-0.5.809 
Compiler                            neuronx-cc-2.12.68.0 
Neuron Distributed                  neuronx_distributed-0.6.0 
Compiler                            neuronx_hwm-2.12.0.0 
TensorBoard                         tensorboard-plugin-neuronx-2.6.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.8.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-1.13.1.1.13.1 
PyTorch                             torch-neuronx-2.0.0.2.0.1b0 
PyTorch                             torch-neuronx-2.1.1.2.0.1b0 
PyTorch                             torch_xla-1.13.1+torchneurond 
PyTorch                             torch_xla-2.1.1 
Transformers Neuron                 transformers-neuronx-0.9.474

Inf1 packages

List of packages in Neuron 2.17.0:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.15.9.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.19.16.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.19.16.0 
OCI                                 aws-neuronx-oci-hook-2.2.45.0 
System Tools                        aws-neuronx-tools-2.17.0.0 
Compiler                            dmlc_nnvm-1.18.2.0 
Compiler                            dmlc_topi-1.18.2.0 
Compiler                            dmlc_tvm-1.18.2.0 
Compiler                            inferentia_hwm-1.16.2.0 
MXNet                               mx_neuron-1.8.0.2.4.40.0 
MXNet                               mxnet_neuron-1.5.1.1.10.0.0 
Compiler                            neuron-cc-1.21.0.0 
Perf Tools                          neuronperf-1.8.15.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.8.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.10.8.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.10.8.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.10.8.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.10.8.0 
PyTorch                             torch-neuron-1.10.2.2.9.17.0 
PyTorch                             torch-neuron-1.11.0.2.9.17.0 
PyTorch                             torch-neuron-1.12.1.2.9.17.0 
PyTorch                             torch-neuron-1.13.1.2.9.17.0 
PyTorch                             torch-neuron-1.9.1.2.9.17.0

Neuron 2.16.1 (01/18/2024)

Trn1 packages

List of packages in Neuron 2.16.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.19.7.0 
Driver                              aws-neuronx-dkms-2.15.9.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.9.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.9.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.19.16.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.19.16.0 
OCI                                 aws-neuronx-oci-hook-2.2.45.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.19.5.0 
System Tools                        aws-neuronx-tools-2.16.1.0 
Framework                           libneuronxla-2.0.498 
Framework                           libneuronxla-0.5.669 
Compiler                            neuronx-cc-2.12.68.0 
Neuron Distributed                  neuronx_distributed-0.6.0 
Compiler                            neuronx_hwm-2.12.0.0 
TensorBoard                         tensorboard-plugin-neuronx-2.6.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.8.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-1.13.1.1.13.0 
PyTorch                             torch-neuronx-2.0.0.2.0.1b0 
PyTorch                             torch-neuronx-2.1.1.2.0.0b0 
PyTorch                             torch_xla-1.13.1+torchneurond 
PyTorch                             torch_xla-2.1.1 
Transformers Neuron                 transformers-neuronx-0.9.474

Inf2 packages

List of packages in Neuron 2.16.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.19.7.0 
Driver                              aws-neuronx-dkms-2.15.9.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.9.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.9.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.19.16.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.19.16.0 
OCI                                 aws-neuronx-oci-hook-2.2.45.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.19.5.0 
System Tools                        aws-neuronx-tools-2.16.1.0 
Framework                           libneuronxla-2.0.498 
Framework                           libneuronxla-0.5.669 
Compiler                            neuronx-cc-2.12.68.0 
Neuron Distributed                  neuronx_distributed-0.6.0 
Compiler                            neuronx_hwm-2.12.0.0 
TensorBoard                         tensorboard-plugin-neuronx-2.6.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.8.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-1.13.1.1.13.0 
PyTorch                             torch-neuronx-2.0.0.2.0.1b0 
PyTorch                             torch-neuronx-2.1.1.2.0.0b0 
PyTorch                             torch_xla-1.13.1+torchneurond 
PyTorch                             torch_xla-2.1.1 
Transformers Neuron                 transformers-neuronx-0.9.474

Inf1 packages

List of packages in Neuron 2.16.1:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.15.9.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.19.16.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.19.16.0 
OCI                                 aws-neuronx-oci-hook-2.2.45.0 
System Tools                        aws-neuronx-tools-2.16.1.0 
Compiler                            dmlc_nnvm-1.18.2.0 
Compiler                            dmlc_topi-1.18.2.0 
Compiler                            dmlc_tvm-1.18.2.0 
Compiler                            inferentia_hwm-1.16.2.0 
MXNet                               mx_neuron-1.8.0.2.4.40.0 
MXNet                               mxnet_neuron-1.5.1.1.10.0.0 
Compiler                            neuron-cc-1.21.0.0 
Perf Tools                          neuronperf-1.8.15.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.8.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.10.8.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.10.8.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.10.8.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.10.8.0 
PyTorch                             torch-neuron-1.10.2.2.9.17.0 
PyTorch                             torch-neuron-1.11.0.2.9.17.0 
PyTorch                             torch-neuron-1.12.1.2.9.17.0 
PyTorch                             torch-neuron-1.13.1.2.9.17.0 
PyTorch                             torch-neuron-1.9.1.2.9.17.0

Neuron 2.16.0 (12/21/2023)

Trn1 packages

List of packages in Neuron 2.16.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.19.7.0 
Driver                              aws-neuronx-dkms-2.15.9.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.9.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.9.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.19.16.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.19.16.0 
OCI                                 aws-neuronx-oci-hook-2.2.45.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.19.5.0 
System Tools                        aws-neuronx-tools-2.16.1.0 
Framework                           libneuronxla-2.0.498 
Framework                           libneuronxla-0.5.669 
Compiler                            neuronx-cc-2.12.54.0 
Neuron Distributed                  neuronx_distributed-0.6.0 
Compiler                            neuronx_hwm-2.12.0.0 
TensorBoard                         tensorboard-plugin-neuronx-2.6.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.8.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-1.13.1.1.13.0 
PyTorch                             torch-neuronx-2.0.0.2.0.1b0 
PyTorch                             torch-neuronx-2.1.1.2.0.0b0 
PyTorch                             torch_xla-1.13.1+torchneurond 
PyTorch                             torch_xla-2.1.1 
Transformers Neuron                 transformers-neuronx-0.9.474

Inf2 packages

List of packages in Neuron 2.16.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.19.7.0 
Driver                              aws-neuronx-dkms-2.15.9.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.9.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.9.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.19.16.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.19.16.0 
OCI                                 aws-neuronx-oci-hook-2.2.45.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.19.5.0 
System Tools                        aws-neuronx-tools-2.16.1.0 
Framework                           libneuronxla-2.0.498 
Framework                           libneuronxla-0.5.669 
Compiler                            neuronx-cc-2.12.54.0 
Neuron Distributed                  neuronx_distributed-0.6.0 
Compiler                            neuronx_hwm-2.12.0.0 
TensorBoard                         tensorboard-plugin-neuronx-2.6.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.8.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-1.13.1.1.13.0 
PyTorch                             torch-neuronx-2.0.0.2.0.1b0 
PyTorch                             torch-neuronx-2.1.1.2.0.0b0 
PyTorch                             torch_xla-1.13.1+torchneurond 
PyTorch                             torch_xla-2.1.1 
Transformers Neuron                 transformers-neuronx-0.9.474

Inf1 packages

List of packages in Neuron 2.16.0:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.15.9.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.19.16.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.19.16.0 
OCI                                 aws-neuronx-oci-hook-2.2.45.0 
System Tools                        aws-neuronx-tools-2.16.1.0 
Compiler                            dmlc_nnvm-1.18.2.0 
Compiler                            dmlc_topi-1.18.2.0 
Compiler                            dmlc_tvm-1.18.2.0 
Compiler                            inferentia_hwm-1.16.2.0 
MXNet                               mx_neuron-1.8.0.2.4.40.0 
MXNet                               mxnet_neuron-1.5.1.1.10.0.0 
Compiler                            neuron-cc-1.21.0.0 
Perf Tools                          neuronperf-1.8.15.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.8.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.8.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.10.8.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.10.8.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.10.8.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.10.8.0 
PyTorch                             torch-neuron-1.10.2.2.9.17.0 
PyTorch                             torch-neuron-1.11.0.2.9.17.0 
PyTorch                             torch-neuron-1.12.1.2.9.17.0 
PyTorch                             torch-neuron-1.13.1.2.9.17.0 
PyTorch                             torch-neuron-1.9.1.2.9.17.0

Neuron 2.15.2 (11/17/2023)

Trn1 packages

List of packages in Neuron 2.15.2:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.18.19.0 
Driver                              aws-neuronx-dkms-2.14.5.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.8.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.8.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.18.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.18.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.27.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.18.15.0 
System Tools                        aws-neuronx-tools-2.15.4.0 
Framework                           libneuronxla-1.0.680 
Framework                           libneuronxla-0.5.570 
Compiler                            neuronx-cc-2.11.0.35 
Neuron Distributed                  neuronx_distributed-0.5.0 
Compiler                            neuronx_hwm-2.11.0.2 
TensorBoard                         tensorboard-plugin-neuronx-2.5.43.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.2.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-1.13.1.1.12.1 
PyTorch                             torch-neuronx-2.0.0.2.0.1b0 
PyTorch                             torch_xla-1.13.1+torchneuronc 
PyTorch                             torch_xla-2.0.0+torchneuron0 
Transformers Neuron                 transformers-neuronx-0.8.268

Inf2 packages

List of packages in Neuron 2.15.2:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.18.19.0 
Driver                              aws-neuronx-dkms-2.14.5.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.8.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.8.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.18.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.18.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.27.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.18.15.0 
System Tools                        aws-neuronx-tools-2.15.4.0 
Framework                           libneuronxla-1.0.680 
Framework                           libneuronxla-0.5.570 
Compiler                            neuronx-cc-2.11.0.35 
Neuron Distributed                  neuronx_distributed-0.5.0 
Compiler                            neuronx_hwm-2.11.0.2 
TensorBoard                         tensorboard-plugin-neuronx-2.5.43.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.2.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-1.13.1.1.12.1 
PyTorch                             torch-neuronx-2.0.0.2.0.1b0 
PyTorch                             torch_xla-1.13.1+torchneuronc 
PyTorch                             torch_xla-2.0.0+torchneuron0 
Transformers Neuron                 transformers-neuronx-0.8.268

Inf1 packages

List of packages in Neuron 2.15.2:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.14.5.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.18.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.18.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.27.0 
System Tools                        aws-neuronx-tools-2.15.4.0 
Compiler                            dmlc_nnvm-1.18.1.0 
Compiler                            dmlc_topi-1.18.1.0 
Compiler                            dmlc_tvm-1.18.1.0 
Compiler                            inferentia_hwm-1.16.1.0 
MXNet                               mx_neuron-1.8.0.2.4.25.0 
MXNet                               mxnet_neuron-1.5.1.1.10.0.0 
Compiler                            neuron-cc-1.20.3.0 
Perf Tools                          neuronperf-1.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.2.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.10.2.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.10.2.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.10.2.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.10.2.0 
PyTorch                             torch-neuron-1.10.2.2.9.6.0 
PyTorch                             torch-neuron-1.11.0.2.9.6.0 
PyTorch                             torch-neuron-1.12.1.2.9.6.0 
PyTorch                             torch-neuron-1.13.1.2.9.6.0 
PyTorch                             torch-neuron-1.9.1.2.9.6.0 
Runtime Library                     libnrt.so (Version 2.18.15)

Neuron 2.15.1 (11/09/2023)

Trn1 packages

List of packages in Neuron 2.15.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.18.19.0 
Driver                              aws-neuronx-dkms-2.14.5.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.8.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.8.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.18.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.18.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.27.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.18.15.0 
System Tools                        aws-neuronx-tools-2.15.4.0 
Framework                           libneuronxla-1.0.680 
Framework                           libneuronxla-0.5.570 
Compiler                            neuronx-cc-2.11.0.34 
Neuron Distributed                  neuronx_distributed-0.5.0 
Compiler                            neuronx_hwm-2.11.0.2 
TensorBoard                         tensorboard-plugin-neuronx-2.5.43.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.2.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-1.13.1.1.12.1 
PyTorch                             torch-neuronx-2.0.0.2.0.1b0 
PyTorch                             torch_xla-1.13.1+torchneuronc 
PyTorch                             torch_xla-2.0.0+torchneuron0 
Transformers Neuron                 transformers-neuronx-0.8.268

Inf2 packages

List of packages in Neuron 2.15.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.18.19.0 
Driver                              aws-neuronx-dkms-2.14.5.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.8.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.8.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.18.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.18.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.27.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.18.15.0 
System Tools                        aws-neuronx-tools-2.15.4.0 
Framework                           libneuronxla-1.0.680 
Framework                           libneuronxla-0.5.570 
Compiler                            neuronx-cc-2.11.0.34 
Neuron Distributed                  neuronx_distributed-0.5.0 
Compiler                            neuronx_hwm-2.11.0.2 
TensorBoard                         tensorboard-plugin-neuronx-2.5.43.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.2.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-1.13.1.1.12.1 
PyTorch                             torch-neuronx-2.0.0.2.0.1b0 
PyTorch                             torch_xla-1.13.1+torchneuronc 
PyTorch                             torch_xla-2.0.0+torchneuron0 
Transformers Neuron                 transformers-neuronx-0.8.268

Inf1 packages

List of packages in Neuron 2.15.1:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.14.5.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.18.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.18.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.27.0 
System Tools                        aws-neuronx-tools-2.15.4.0 
Compiler                            dmlc_nnvm-1.18.1.0 
Compiler                            dmlc_topi-1.18.1.0 
Compiler                            dmlc_tvm-1.18.1.0 
Compiler                            inferentia_hwm-1.16.1.0 
MXNet                               mx_neuron-1.8.0.2.4.25.0 
MXNet                               mxnet_neuron-1.5.1.1.10.0.0 
Compiler                            neuron-cc-1.20.3.0 
Perf Tools                          neuronperf-1.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.2.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.10.2.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.10.2.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.10.2.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.10.2.0 
PyTorch                             torch-neuron-1.10.2.2.9.6.0 
PyTorch                             torch-neuron-1.11.0.2.9.6.0 
PyTorch                             torch-neuron-1.12.1.2.9.6.0 
PyTorch                             torch-neuron-1.13.1.2.9.6.0 
PyTorch                             torch-neuron-1.9.1.2.9.6.0 
Runtime Library                     libnrt.so (Version 2.18.15)

Neuron 2.15.0 (10/26/2023)

Trn1 packages

List of packages in Neuron 2.15.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.18.18.0 
Driver                              aws-neuronx-dkms-2.14.5.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.8.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.8.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.18.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.18.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.27.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.18.14.0 
System Tools                        aws-neuronx-tools-2.15.4.0 
Framework                           libneuronxla-1.0.663 
Framework                           libneuronxla-0.5.538 
Compiler                            neuronx-cc-2.11.0.34 
Neuron Distributed                  neuronx_distributed-0.5.0 
Compiler                            neuronx_hwm-2.11.0.2 
TensorBoard                         tensorboard-plugin-neuronx-2.5.43.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.2.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-1.13.1.1.12.0 
PyTorch                             torch-neuronx-2.0.0.2.0.0b0 
PyTorch                             torch_xla-1.13.1+torchneuronc 
PyTorch                             torch_xla-2.0.0+torchneuron0 
Transformers Neuron                 transformers-neuronx-0.8.268

Inf2 packages

List of packages in Neuron 2.15.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.18.18.0 
Driver                              aws-neuronx-dkms-2.14.5.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.8.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.8.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.18.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.18.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.27.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.18.14.0 
System Tools                        aws-neuronx-tools-2.15.4.0 
Framework                           libneuronxla-1.0.663 
Framework                           libneuronxla-0.5.538 
Compiler                            neuronx-cc-2.11.0.34 
Neuron Distributed                  neuronx_distributed-0.5.0 
Compiler                            neuronx_hwm-2.11.0.2 
TensorBoard                         tensorboard-plugin-neuronx-2.5.43.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.2.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
PyTorch                             torch-neuronx-1.13.1.1.12.0 
PyTorch                             torch-neuronx-2.0.0.2.0.0b0 
PyTorch                             torch_xla-1.13.1+torchneuronc 
PyTorch                             torch_xla-2.0.0+torchneuron0 
Transformers Neuron                 transformers-neuronx-0.8.268

Inf1 packages

List of packages in Neuron 2.15.0:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.14.5.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.18.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.18.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.27.0 
System Tools                        aws-neuronx-tools-2.15.4.0 
Compiler                            dmlc_nnvm-1.18.1.0 
Compiler                            dmlc_topi-1.18.1.0 
Compiler                            dmlc_tvm-1.18.1.0 
Compiler                            inferentia_hwm-1.16.1.0 
MXNet                               mx_neuron-1.8.0.2.4.25.0 
MXNet                               mxnet_neuron-1.5.1.1.10.0.0 
Compiler                            neuron-cc-1.20.3.0 
Perf Tools                          neuronperf-1.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.2.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.10.2.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.10.2.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.10.2.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.10.2.0 
PyTorch                             torch-neuron-1.10.2.2.9.6.0 
PyTorch                             torch-neuron-1.11.0.2.9.6.0 
PyTorch                             torch-neuron-1.12.1.2.9.6.0 
PyTorch                             torch-neuron-1.13.1.2.9.6.0 
PyTorch                             torch-neuron-1.9.1.2.9.6.0 
Runtime Library                     libnrt.so (Version 2.18.14)

Neuron 2.14.1 (09/26/2023)

Trn1 packages

List of packages in Neuron 2.14.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.17.9.0 
Driver                              aws-neuronx-dkms-2.13.4.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.7.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.7.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.17.7.0 
System Tools                        aws-neuronx-tools-2.14.6.0 
Framework                           libneuronxla-0.5.476 
Compiler                            neuronx_hwm-2.10.0.5 
PyTorch                             torch_xla-1.13.1+torchneuronb 
Compiler                            neuronx-cc-2.10.0.35 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.17.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.17.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.22.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.11.0 
Transformers Neuron                 transformers-neuronx-0.7.84 
Neuron Distributed                  neuronx_distributed-0.4.0

Inf2 packages

List of packages in Neuron 2.14.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.17.9.0 
Driver                              aws-neuronx-dkms-2.13.4.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.7.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.7.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.17.7.0 
System Tools                        aws-neuronx-tools-2.14.6.0 
Framework                           libneuronxla-0.5.476 
Compiler                            neuronx_hwm-2.10.0.5 
PyTorch                             torch_xla-1.13.1+torchneuronb 
Compiler                            neuronx-cc-2.10.0.35 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.17.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.17.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.22.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.11.0 
Transformers Neuron                 transformers-neuronx-0.7.84 
Neuron Distributed                  neuronx_distributed-0.4.0

Inf1 packages

List of packages in Neuron 2.14.1:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.13.4.0 
System Tools                        aws-neuronx-tools-2.14.6.0 
Compiler                            neuron-cc-1.19.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.17.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.17.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.22.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
PyTorch                             torch-neuron-1.10.2.2.9.1.0 
PyTorch                             torch-neuron-1.11.0.2.9.1.0 
PyTorch                             torch-neuron-1.12.1.2.9.1.0 
PyTorch                             torch-neuron-1.13.1.2.9.1.0 
PyTorch                             torch-neuron-1.9.1.2.9.1.0 
MXNet                               mxnet_neuron-1.5.1.1.10.39.0 
MXNet                               mx_neuron-1.8.0.2.4.10.0 
Perf Tools                          neuronperf-1.8.7.0 
Runtime Library                     libnrt.so (Version 2.12.23.0)
Compiler                            dmlc_nnvm-1.17.2.0 
Compiler                            dmlc_topi-1.17.2.0 
Compiler                            dmlc_tvm-1.17.2.0 
Compiler                            inferentia_hwm-1.15.2.0

Neuron 2.14.0 (09/15/2023)

Trn1 packages

List of packages in Neuron 2.14.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.17.9.0 
Driver                              aws-neuronx-dkms-2.13.4.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.7.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.7.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.17.7.0 
System Tools                        aws-neuronx-tools-2.14.6.0 
Framework                           libneuronxla-0.5.476 
Compiler                            neuronx_hwm-2.10.0.5 
PyTorch                             torch_xla-1.13.1+torchneuronb 
Compiler                            neuronx-cc-2.10.0.34 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.17.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.17.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.22.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.11.0 
Transformers Neuron                 transformers-neuronx-0.7.84 
Neuron Distributed                  neuronx_distributed-0.4.0

Inf2 packages

List of packages in Neuron 2.14.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.17.9.0 
Driver                              aws-neuronx-dkms-2.13.4.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.7.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.7.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.17.7.0 
System Tools                        aws-neuronx-tools-2.14.6.0 
Framework                           libneuronxla-0.5.476 
Compiler                            neuronx_hwm-2.10.0.5 
PyTorch                             torch_xla-1.13.1+torchneuronb 
Compiler                            neuronx-cc-2.10.0.34 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.17.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.17.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.22.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.11.0 
Transformers Neuron                 transformers-neuronx-0.7.84 
Neuron Distributed                  neuronx_distributed-0.4.0

Inf1 packages

List of packages in Neuron 2.14.0:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.13.4.0 
System Tools                        aws-neuronx-tools-2.14.6.0 
Compiler                            neuron-cc-1.19.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.17.3.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.17.3.0 
OCI                                 aws-neuronx-oci-hook-2.2.22.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
PyTorch                             torch-neuron-1.10.2.2.9.1.0 
PyTorch                             torch-neuron-1.11.0.2.9.1.0 
PyTorch                             torch-neuron-1.12.1.2.9.1.0 
PyTorch                             torch-neuron-1.13.1.2.9.1.0 
PyTorch                             torch-neuron-1.9.1.2.9.1.0 
MXNet                               mxnet_neuron-1.5.1.1.10.39.0 
MXNet                               mx_neuron-1.8.0.2.4.10.0 
Perf Tools                          neuronperf-1.8.7.0 
Runtime Library                     libnrt.so (Version 2.12.23.0)
Compiler                            dmlc_nnvm-1.17.2.0 
Compiler                            dmlc_topi-1.17.2.0 
Compiler                            dmlc_tvm-1.17.2.0 
Compiler                            inferentia_hwm-1.15.2.0

Neuron 2.13.2 (09/01/2023)

Trn1 packages

List of packages in Neuron 2.13.2:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.16.16.0 
Driver                              aws-neuronx-dkms-2.12.18.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.6.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.6.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.16.14.0 
System Tools                        aws-neuronx-tools-2.13.4.0 
Framework                           libneuronxla-0.5.440 
Compiler                            neuronx_hwm-2.9.0.2 
PyTorch                             torch_xla-1.13.1+torchneurona 
Compiler                            neuronx-cc-2.9.0.40 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.16.18.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.16.18.0 
OCI                                 aws-neuronx-oci-hook-2.2.25.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.10.1 
Transformers Neuron                 transformers-neuronx-0.6.106 
Neuron Distributed                  neuronx_distributed-0.3.0

Inf2 packages

List of packages in Neuron 2.13.2:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.16.16.0 
Driver                              aws-neuronx-dkms-2.12.18.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.6.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.6.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.16.14.0 
System Tools                        aws-neuronx-tools-2.13.4.0 
Framework                           libneuronxla-0.5.440 
Compiler                            neuronx_hwm-2.9.0.2 
PyTorch                             torch_xla-1.13.1+torchneurona 
Compiler                            neuronx-cc-2.9.0.40 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.16.18.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.16.18.0 
OCI                                 aws-neuronx-oci-hook-2.2.25.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.10.1 
Transformers Neuron                 transformers-neuronx-0.6.106 
Neuron Distributed                  neuronx_distributed-0.3.0

Inf1 packages

List of packages in Neuron 2.13.2:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.12.18.0 
System Tools                        aws-neuronx-tools-2.13.4.0 
Compiler                            neuron-cc-1.18.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.16.18.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.16.18.0 
OCI                                 aws-neuronx-oci-hook-2.2.25.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
PyTorch                             torch-neuron-1.10.2.2.9.1.0 
PyTorch                             torch-neuron-1.11.0.2.9.1.0 
PyTorch                             torch-neuron-1.12.1.2.9.1.0 
PyTorch                             torch-neuron-1.13.1.2.9.1.0 
PyTorch                             torch-neuron-1.9.1.2.9.1.0 
MXNet                               mxnet_neuron-1.5.1.1.10.39.0 
MXNet                               mx_neuron-1.8.0.2.4.10.0 
Perf Tools                          neuronperf-1.8.7.0 
Runtime Library                     libnrt.so (Version 2.12.23.0)
Compiler                            dmlc_nnvm-1.16.1.0 
Compiler                            dmlc_topi-1.16.1.0 
Compiler                            dmlc_tvm-1.16.1.0 
Compiler                            inferentia_hwm-1.15.0.0

Neuron 2.13.1 (08/29/2023)

Trn1 packages

List of packages in Neuron 2.13.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.16.8.0 
Driver                              aws-neuronx-dkms-2.12.11.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.6.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.6.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.16.8.0 
System Tools                        aws-neuronx-tools-2.13.4.0 
Framework                           libneuronxla-0.5.425 
Compiler                            neuronx_hwm-2.9.0.2 
PyTorch                             torch_xla-1.13.1+torchneurona 
Compiler                            neuronx-cc-2.9.0.40 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.16.9.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.16.9.0 
OCI                                 aws-neuronx-oci-hook-2.2.21.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.10.0 
Transformers Neuron                 transformers-neuronx-0.6.106 
Neuron Distributed                  neuronx_distributed-0.3.0

Inf2 packages

List of packages in Neuron 2.13.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.16.8.0 
Driver                              aws-neuronx-dkms-2.12.11.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.6.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.6.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.16.8.0 
System Tools                        aws-neuronx-tools-2.13.4.0 
Framework                           libneuronxla-0.5.425 
Compiler                            neuronx_hwm-2.9.0.2 
PyTorch                             torch_xla-1.13.1+torchneurona 
Compiler                            neuronx-cc-2.9.0.40 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.16.9.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.16.9.0 
OCI                                 aws-neuronx-oci-hook-2.2.21.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.10.0 
Transformers Neuron                 transformers-neuronx-0.6.106 
Neuron Distributed                  neuronx_distributed-0.3.0

Inf1 packages

List of packages in Neuron 2.13.1:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.12.11.0 
System Tools                        aws-neuronx-tools-2.13.4.0 
Compiler                            neuron-cc-1.18.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.16.9.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.16.9.0 
OCI                                 aws-neuronx-oci-hook-2.2.21.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
PyTorch                             torch-neuron-1.10.2.2.9.1.0 
PyTorch                             torch-neuron-1.11.0.2.9.1.0 
PyTorch                             torch-neuron-1.12.1.2.9.1.0 
PyTorch                             torch-neuron-1.13.1.2.9.1.0 
PyTorch                             torch-neuron-1.9.1.2.9.1.0 
MXNet                               mxnet_neuron-1.5.1.1.10.39.0 
MXNet                               mx_neuron-1.8.0.2.4.10.0 
Perf Tools                          neuronperf-1.8.7.0 
Runtime Library                     libnrt.so (Version 2.12.23.0)
Compiler                            dmlc_nnvm-1.16.1.0 
Compiler                            dmlc_topi-1.16.1.0 
Compiler                            dmlc_tvm-1.16.1.0 
Compiler                            inferentia_hwm-1.15.0.0

Neuron 2.13.0 (08/28/2023)

Trn1 packages

List of packages in Neuron 2.13.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.16.8.0 
Driver                              aws-neuronx-dkms-2.12.11.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.6.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.6.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.16.8.0 
System Tools                        aws-neuronx-tools-2.13.4.0 
Framework                           libneuronxla-0.5.425 
Compiler                            neuronx_hwm-2.9.0.1 
PyTorch                             torch_xla-1.13.1+torchneurona 
Compiler                            neuronx-cc-2.9.0.16 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.16.9.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.16.9.0 
OCI                                 aws-neuronx-oci-hook-2.2.21.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.10.0 
Transformers Neuron                 transformers-neuronx-0.6.106 
Neuron Distributed                  neuronx_distributed-0.3.0

Inf2 packages

List of packages in Neuron 2.13.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.16.8.0 
Driver                              aws-neuronx-dkms-2.12.11.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.6.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.6.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.16.8.0 
System Tools                        aws-neuronx-tools-2.13.4.0 
Framework                           libneuronxla-0.5.425 
Compiler                            neuronx_hwm-2.9.0.1 
PyTorch                             torch_xla-1.13.1+torchneurona 
Compiler                            neuronx-cc-2.9.0.16 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.16.9.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.16.9.0 
OCI                                 aws-neuronx-oci-hook-2.2.21.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.10.0 
Transformers Neuron                 transformers-neuronx-0.6.106 
Neuron Distributed                  neuronx_distributed-0.3.0

Inf1 packages

List of packages in Neuron 2.13.0:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.12.11.0 
System Tools                        aws-neuronx-tools-2.13.4.0 
Compiler                            neuron-cc-1.18.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.16.9.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.16.9.0 
OCI                                 aws-neuronx-oci-hook-2.2.21.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.10.1.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.10.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.10.1.0 
PyTorch                             torch-neuron-1.10.2.2.9.1.0 
PyTorch                             torch-neuron-1.11.0.2.9.1.0 
PyTorch                             torch-neuron-1.12.1.2.9.1.0 
PyTorch                             torch-neuron-1.13.1.2.9.1.0 
PyTorch                             torch-neuron-1.9.1.2.9.1.0 
MXNet                               mxnet_neuron-1.5.1.1.10.39.0 
MXNet                               mx_neuron-1.8.0.2.4.10.0 
Perf Tools                          neuronperf-1.8.7.0 
Runtime Library                     libnrt.so (Version 2.12.23.0)
Compiler                            dmlc_nnvm-1.16.1.0 
Compiler                            dmlc_topi-1.16.1.0 
Compiler                            dmlc_tvm-1.16.1.0 
Compiler                            inferentia_hwm-1.15.0.0

Neuron 2.12.2 (08/20/2023)

Trn1 packages

List of packages in Neuron 2.12.2:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.15.16.0 
Driver                              aws-neuronx-dkms-2.11.9.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.5.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.5.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.15.14.0 
System Tools                        aws-neuronx-tools-2.12.2.0 
Framework                           libneuronxla-0.5.413 
Compiler                            neuronx_hwm-2.8.0.3 
PyTorch                             torch_xla-1.13.1+torchneuron8 
Compiler                            neuronx-cc-2.8.0.25 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.15.6.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.15.6.0 
OCI                                 aws-neuronx-oci-hook-2.2.16.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.9.3.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.9.1 
Transformers Neuron                 transformers-neuronx-0.5.58 
Neuron Distributed                  neuronx_distributed-0.2.0

Inf2 packages

List of packages in Neuron 2.12.2:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.15.16.0 
Driver                              aws-neuronx-dkms-2.11.9.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.5.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.5.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.15.14.0 
System Tools                        aws-neuronx-tools-2.12.2.0 
Framework                           libneuronxla-0.5.413 
Compiler                            neuronx_hwm-2.8.0.3 
PyTorch                             torch_xla-1.13.1+torchneuron8 
Compiler                            neuronx-cc-2.8.0.25 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.15.6.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.15.6.0 
OCI                                 aws-neuronx-oci-hook-2.2.16.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.9.3.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.9.1 
Transformers Neuron                 transformers-neuronx-0.5.58 
Neuron Distributed                  neuronx_distributed-0.2.0

Inf1 packages

List of packages in Neuron 2.12.2:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.11.9.0 
System Tools                        aws-neuronx-tools-2.12.2.0 
Compiler                            neuron-cc-1.17.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.15.6.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.15.6.0 
OCI                                 aws-neuronx-oci-hook-2.2.16.0 
TensorFlow                          tensorflow-neuron-1.15.5.2.9.3.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.9.3.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.9.3.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.9.3.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.9.3.0 
PyTorch                             torch-neuron-1.10.2.2.8.9.0 
PyTorch                             torch-neuron-1.11.0.2.8.9.0 
PyTorch                             torch-neuron-1.12.1.2.8.9.0 
PyTorch                             torch-neuron-1.13.1.2.8.9.0 
PyTorch                             torch-neuron-1.9.1.2.8.9.0 
MXNet                               mxnet_neuron-1.5.1.1.10.39.0 
MXNet                               mx_neuron-1.8.0.2.4.10.0 
Perf Tools                          neuronperf-1.8.7.0 
Runtime Library                     libnrt.so (Version 2.12.23.0)
Compiler                            dmlc_nnvm-1.16.1.0 
Compiler                            dmlc_topi-1.16.1.0 
Compiler                            dmlc_tvm-1.16.1.0 
Compiler                            inferentia_hwm-1.14.4.0

Neuron 2.12.1 (08/09/2023)

Trn1 packages

List of packages in Neuron 2.12.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.15.16.0 
Driver                              aws-neuronx-dkms-2.11.9.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.5.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.5.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.15.14.0 
System Tools                        aws-neuronx-tools-2.12.2.0 
Framework                           libneuronxla-0.5.413 
Compiler                            neuronx_hwm-2.8.0.3 
PyTorch                             torch_xla-1.13.1+torchneuron8 
Compiler                            neuronx-cc-2.8.0.25 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.15.6.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.15.6.0 
OCI                                 aws-neuronx-oci-hook-2.2.16.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.9.3.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.9.0 
Transformers Neuron                 transformers-neuronx-0.5.58 
Neuron Distributed                  neuronx_distributed-0.2.0

Inf2 packages

List of packages in Neuron 2.12.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.15.16.0 
Driver                              aws-neuronx-dkms-2.11.9.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.5.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.5.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.15.14.0 
System Tools                        aws-neuronx-tools-2.12.2.0 
Framework                           libneuronxla-0.5.413 
Compiler                            neuronx_hwm-2.8.0.3 
PyTorch                             torch_xla-1.13.1+torchneuron8 
Compiler                            neuronx-cc-2.8.0.25 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.15.6.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.15.6.0 
OCI                                 aws-neuronx-oci-hook-2.2.16.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.9.3.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.9.0 
Transformers Neuron                 transformers-neuronx-0.5.58 
Neuron Distributed                  neuronx_distributed-0.2.0

Inf1 packages

List of packages in Neuron 2.12.1:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.11.9.0 
System Tools                        aws-neuronx-tools-2.12.2.0 
Compiler                            neuron-cc-1.17.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.15.6.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.15.6.0 
OCI                                 aws-neuronx-oci-hook-2.2.16.0 
TensorFlow                          tensorflow-neuron-1.15.5.2.9.3.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.9.3.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.9.3.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.9.3.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.9.3.0 
PyTorch                             torch-neuron-1.10.2.2.8.9.0 
PyTorch                             torch-neuron-1.11.0.2.8.9.0 
PyTorch                             torch-neuron-1.12.1.2.8.9.0 
PyTorch                             torch-neuron-1.13.1.2.8.9.0 
PyTorch                             torch-neuron-1.9.1.2.8.9.0 
MXNet                               mxnet_neuron-1.5.1.1.10.39.0 
MXNet                               mx_neuron-1.8.0.2.4.10.0 
Perf Tools                          neuronperf-1.8.7.0 
Runtime Library                     libnrt.so (Version 2.12.23.0)
Compiler                            dmlc_nnvm-1.16.1.0 
Compiler                            dmlc_topi-1.16.1.0 
Compiler                            dmlc_tvm-1.16.1.0 
Compiler                            inferentia_hwm-1.14.4.0

Neuron 2.12.0 (07/19/2023)

Trn1 packages

List of packages in Neuron 2.12.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.15.13.0 
Driver                              aws-neuronx-dkms-2.11.9.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.5.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.5.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.15.11.0 
System Tools                        aws-neuronx-tools-2.12.2.0 
Framework                           libneuronxla-0.5.391 
Compiler                            neuronx_hwm-2.8.0.3 
PyTorch                             torch_xla-1.13.1+torchneuron8 
Compiler                            neuronx-cc-2.8.0.25 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.15.6.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.15.6.0 
OCI                                 aws-neuronx-oci-hook-2.2.16.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.9.3.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.9.0 
Transformers Neuron                 transformers-neuronx-0.5.58 
Neuron Distributed                  neuronx_distributed-0.2.0

Inf2 packages

List of packages in Neuron 2.12.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.15.13.0 
Driver                              aws-neuronx-dkms-2.11.9.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.5.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.5.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.15.11.0 
System Tools                        aws-neuronx-tools-2.12.2.0 
Framework                           libneuronxla-0.5.391 
Compiler                            neuronx_hwm-2.8.0.3 
PyTorch                             torch_xla-1.13.1+torchneuron8 
Compiler                            neuronx-cc-2.8.0.25 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.15.6.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.15.6.0 
OCI                                 aws-neuronx-oci-hook-2.2.16.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.9.3.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.39.0 
PyTorch                             torch-neuronx-1.13.1.1.9.0 
Transformers Neuron                 transformers-neuronx-0.5.58 
Neuron Distributed                  neuronx_distributed-0.2.0

Inf1 packages

List of packages in Neuron 2.12.0:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.11.9.0 
System Tools                        aws-neuronx-tools-2.12.2.0 
Compiler                            neuron-cc-1.17.0.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.15.6.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.15.6.0 
OCI                                 aws-neuronx-oci-hook-2.2.16.0 
TensorFlow                          tensorflow-neuron-1.15.5.2.9.3.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.9.3.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.9.3.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.9.3.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.9.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.9.3.0 
PyTorch                             torch-neuron-1.10.2.2.8.9.0 
PyTorch                             torch-neuron-1.11.0.2.8.9.0 
PyTorch                             torch-neuron-1.12.1.2.8.9.0 
PyTorch                             torch-neuron-1.13.1.2.8.9.0 
PyTorch                             torch-neuron-1.9.1.2.8.9.0 
MXNet                               mxnet_neuron-1.5.1.1.10.39.0 
MXNet                               mx_neuron-1.8.0.2.4.10.0 
Perf Tools                          neuronperf-1.8.7.0 
Runtime Library                     libnrt.so (Version 2.12.23.0)
Compiler                            dmlc_nnvm-1.16.1.0 
Compiler                            dmlc_topi-1.16.1.0 
Compiler                            dmlc_tvm-1.16.1.0 
Compiler                            inferentia_hwm-1.14.4.0

Neuron 2.11.0 (06/14/2023)

Trn1 packages

List of packages in Neuron 2.11.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.14.9.0 
Driver                              aws-neuronx-dkms-2.10.11.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.4.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.4.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.14.8.0 
System Tools                        aws-neuronx-tools-2.11.10.0 
Framework                           libneuronxla-0.5.326 
Compiler                            neuronx_hwm-2.7.0.3 
PyTorch                             torch_xla-1.13.1+torchneuron7 
Compiler                            neuronx-cc-2.7.0.40 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.14.4.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.14.4.0 
OCI                                 aws-neuronx-oci-hook-2.2.9.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.8.9.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.37.0 
PyTorch                             torch-neuronx-1.13.1.1.8.0 
Transformers Neuron                 transformers-neuronx-0.4.60 
nan                                 islpy-2021.1+aws2021.x.169.0 
Neuron Distributed                  neuronx_distributed-0.1.0

Inf2 packages

List of packages in Neuron 2.11.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.14.9.0 
Driver                              aws-neuronx-dkms-2.10.11.0 
nan                                 aws-neuronx-gpsimd-customop-lib-0.4.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.4.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.14.8.0 
System Tools                        aws-neuronx-tools-2.11.10.0 
Framework                           libneuronxla-0.5.326 
Compiler                            neuronx_hwm-2.7.0.3 
PyTorch                             torch_xla-1.13.1+torchneuron7 
Compiler                            neuronx-cc-2.7.0.40 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.14.4.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.14.4.0 
OCI                                 aws-neuronx-oci-hook-2.2.9.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.8.9.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.37.0 
PyTorch                             torch-neuronx-1.13.1.1.8.0 
Transformers Neuron                 transformers-neuronx-0.4.60 
nan                                 islpy-2021.1+aws2021.x.169.0 
Neuron Distributed                  neuronx_distributed-0.1.0

Inf1 packages

List of packages in Neuron 2.11.0:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.10.11.0 
System Tools                        aws-neuronx-tools-2.11.10.0 
Compiler                            neuron-cc-1.16.2.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.14.4.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.14.4.0 
OCI                                 aws-neuronx-oci-hook-2.2.9.0 
TensorFlow                          tensorflow-neuron-1.15.5.2.8.9.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.8.9.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.8.9.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.8.9.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.8.9.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.8.9.0 
PyTorch                             torch-neuron-1.10.2.2.7.10.0 
PyTorch                             torch-neuron-1.11.0.2.7.10.0 
PyTorch                             torch-neuron-1.12.1.2.7.10.0 
PyTorch                             torch-neuron-1.13.1.2.7.10.0 
PyTorch                             torch-neuron-1.9.1.2.7.10.0 
MXNet                               mxnet_neuron-1.5.1.1.10.39.0 
MXNet                               mx_neuron-1.8.0.2.4.9.0 
Perf Tools                          neuronperf-1.8.6.0 
Runtime Library                     libnrt.so (Version 2.12.23.0)
Compiler                            dmlc_nnvm-1.16.0.0 
Compiler                            dmlc_topi-1.16.0.0 
Compiler                            dmlc_tvm-1.16.0.0 
Compiler                            inferentia_hwm-1.14.2.0 
nan                                 islpy-2021.1+aws2021.x.169.0

Neuron 2.10.0 (05/01/2023)

Trn1 packages

List of packages in Neuron 2.10.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.13.7.0 
Driver                              aws-neuronx-dkms-2.9.4.0 
CustomOps                           aws-neuronx-gpsimd-customop-0.3.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.3.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.13.6.0 
System Tools                        aws-neuronx-tools-2.10.1.0 
Framework                           libneuronxla-0.5.207 
Compiler                            neuronx_hwm-2.6.0.0 
PyTorch                             torch_xla-1.13.1 
Compiler                            neuronx-cc-2.6.0.19 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.13.4.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.13.4.0 
OCI                                 aws-neuronx-oci-hook-2.2.0.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.8.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.8.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.8.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.8.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.8.1.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.26.0 
PyTorch                             torch-neuronx-1.13.1.1.7.0 
Transformers Neuron                 transformers-neuronx-0.3.32 
nan                                 islpy-2021.1

Inf2 packages

List of packages in Neuron 2.10.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.13.7.0 
Driver                              aws-neuronx-dkms-2.9.4.0 
CustomOps                           aws-neuronx-gpsimd-customop-0.3.1.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.3.0.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.13.6.0 
System Tools                        aws-neuronx-tools-2.10.1.0 
Framework                           libneuronxla-0.5.207 
Compiler                            neuronx_hwm-2.6.0.0 
PyTorch                             torch_xla-1.13.1 
Compiler                            neuronx-cc-2.6.0.19 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.13.4.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.13.4.0 
OCI                                 aws-neuronx-oci-hook-2.2.0.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.1.0 
TensorFlow                          tensorflow-neuronx-2.7.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.8.4.2.1.0 
TensorFlow                          tensorflow-neuronx-2.9.3.2.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.8.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.8.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.8.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.8.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.8.1.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.26.0 
PyTorch                             torch-neuronx-1.13.1.1.7.0 
Transformers Neuron                 transformers-neuronx-0.3.32 
nan                                 islpy-2021.1

Inf1 packages

List of packages in Neuron 2.10.0:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.9.4.0 
System Tools                        aws-neuronx-tools-2.10.1.0 
Compiler                            neuron-cc-1.15.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.13.4.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.13.4.0 
OCI                                 aws-neuronx-oci-hook-2.2.0.0 
TensorFlow                          tensorflow-neuron-1.15.5.2.8.1.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.8.1.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.8.1.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.8.1.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.8.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.8.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.8.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.8.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.8.1.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.8.1.0 
PyTorch                             torch-neuron-1.10.2.2.7.1.0 
PyTorch                             torch-neuron-1.11.0.2.7.1.0 
PyTorch                             torch-neuron-1.12.1.2.7.1.0 
PyTorch                             torch-neuron-1.13.1.2.7.1.0 
PyTorch                             torch-neuron-1.9.1.2.7.1.0 
MXNet                               mxnet_neuron-1.5.1.1.10.39.0 
MXNet                               mx_neuron-1.8.0.2.4.1.0 
Perf Tools                          neuronperf-1.8.0.0 
Runtime Library                     libnrt.so (Version 2.12.23.0)
Compiler                            dmlc_nnvm-1.15.0.0 
Compiler                            dmlc_topi-1.15.0.0 
Compiler                            dmlc_tvm-1.15.0.0 
Compiler                            inferentia_hwm-1.14.1 
nan                                 islpy-2021.1

Neuron 2.9.1 (04/19/2023)

Trn1 packages

List of packages in Neuron 2.9.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.12.35.0 
Driver                              aws-neuronx-dkms-2.8.4.0 
CustomOps                           aws-neuronx-gpsimd-customop-0.2.3.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.2.1.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.12.23.0 
System Tools                        aws-neuronx-tools-2.9.5.0 
Framework                           libneuronxla-0.5.205 
Compiler                            neuronx_hwm-2.5.0.0 
PyTorch                             torch_xla-1.13.0 
Compiler                            neuronx-cc-2.5.0.28 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.12.5.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.12.5.0 
OCI Hooks                           aws-neuronx-oci-hooks-2.1.97.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.0.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.7.4.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.7.4.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.7.4.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.7.4.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.7.4.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.25.0 
PyTorch                             torch-neuronx-1.13.0.1.6.1

Inf2 packages

List of packages in Neuron 2.9.1:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.12.35.0 
Driver                              aws-neuronx-dkms-2.8.4.0 
CustomOps                           aws-neuronx-gpsimd-customop-0.2.3.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.2.1.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.12.23.0 
System Tools                        aws-neuronx-tools-2.9.5.0 
Framework                           libneuronxla-0.5.205 
Compiler                            neuronx_hwm-2.5.0.0 
PyTorch                             torch_xla-1.13.0 
Compiler                            neuronx-cc-2.5.0.28 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.12.5.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.12.5.0 
OCI Hooks                           aws-neuronx-oci-hooks-2.1.97.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.0.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.7.4.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.7.4.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.7.4.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.7.4.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.7.4.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.25.0 
PyTorch                             torch-neuronx-1.13.0.1.6.1

Inf1 packages

List of packages in Neuron 2.9.1:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.8.4.0 
System Tools                        aws-neuronx-tools-2.9.5.0 
Compiler                            neuron-cc-1.14.3.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.12.5.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.12.5.0 
OCI Hooks                           aws-neuronx-oci-hooks-2.1.97.0 
TensorFlow                          tensorflow-neuron-1.15.5.2.7.4.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.7.4.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.7.4.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.7.4.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.7.4.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.7.4.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.7.4.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.7.4.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.7.4.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.7.4.0 
PyTorch                             torch-neuron-1.10.2.2.6.6.0 
PyTorch                             torch-neuron-1.11.0.2.6.6.0 
PyTorch                             torch-neuron-1.12.1.2.6.6.0 
PyTorch                             torch-neuron-1.13.1.2.6.6.0 
PyTorch                             torch-neuron-1.9.1.2.6.6.0 
MXNet                               mxnet_neuron-1.5.1.1.10.37.0 
MXNet                               mx_neuron-1.8.0.2.2.127.0 
Perf Tools                          neuronperf-1.7.1.0 
Runtime Library                     libnrt.so (Version 2.12.16.0)

Neuron 2.9.0 (03/28/2023)

Trn1 packages

List of packages in Neuron 2.9.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.12.27.0 
Driver                              aws-neuronx-dkms-2.8.4.0 
CustomOps                           aws-neuronx-gpsimd-customop-0.2.3.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.2.1.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.12.16.0 
System Tools                        aws-neuronx-tools-2.9.5.0 
Framework                           libneuronxla-0.5.173 
Compiler                            neuronx_hwm-2.5.0.0 
PyTorch                             torch_xla-1.13.0 
Compiler                            neuronx-cc-2.5.0.28 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.12.5.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.12.5.0 
OCI Hooks                           aws-neuronx-oci-hooks-2.1.97.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.0.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.7.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.7.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.7.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.7.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.7.3.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.25.0 
PyTorch                             torch-neuronx-1.13.0.1.6.0

Inf2 packages

List of packages in Neuron 2.9.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.12.27.0 
Driver                              aws-neuronx-dkms-2.8.4.0 
CustomOps                           aws-neuronx-gpsimd-customop-0.2.3.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.2.1.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.12.16.0 
System Tools                        aws-neuronx-tools-2.9.5.0 
Framework                           libneuronxla-0.5.173 
Compiler                            neuronx_hwm-2.5.0.0 
PyTorch                             torch_xla-1.13.0 
Compiler                            neuronx-cc-2.5.0.28 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.12.5.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.12.5.0 
OCI Hooks                           aws-neuronx-oci-hooks-2.1.97.0 
TensorFlow                          tensorflow-neuronx-2.10.1.2.0.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.7.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.7.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.7.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.7.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.7.3.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.25.0 
PyTorch                             torch-neuronx-1.13.0.1.6.0

Inf1 packages

List of packages in Neuron 2.9.0:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.8.4.0 
System Tools                        aws-neuronx-tools-2.9.5.0 
Compiler                            neuron-cc-1.14.3.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.12.5.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.12.5.0 
OCI Hooks                           aws-neuronx-oci-hooks-2.1.97.0 
TensorFlow                          tensorflow-neuron-1.15.5.2.7.3.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.7.3.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.7.3.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.7.3.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.7.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.7.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.7.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.7.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.7.3.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.7.3.0 
PyTorch                             torch-neuron-1.10.2.2.6.5.0 
PyTorch                             torch-neuron-1.11.0.2.6.5.0 
PyTorch                             torch-neuron-1.12.1.2.6.5.0 
PyTorch                             torch-neuron-1.13.1.2.6.5.0 
PyTorch                             torch-neuron-1.9.1.2.6.5.0 
MXNet                               mxnet_neuron-1.5.1.1.10.37.0 
MXNet                               mx_neuron-1.8.0.2.2.127.0 
Perf Tools                          neuronperf-1.7.1.0 
Runtime Library                     libnrt.so (Version 2.12.16.0)

Neuron 2.8.0 (02/24/2023)

Trn1 packages

List of packages in Neuron 2.8.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.11.47.0 
Driver                              aws-neuronx-dkms-2.7.33.0 
CustomOps                           aws-neuronx-gpsimd-customop-0.1.23.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.1.7.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.11.43.0 
System Tools                        aws-neuronx-tools-2.8.2.0 
Framework                           libneuronxla-0.5.144 
Compiler                            neuronx_hwm-2.4.0.1 
PyTorch                             torch_xla-1.13.0 
Compiler                            neuronx-cc-2.4.0.21 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.1.12.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.1.12.0 
OCI Hooks                           aws-neuronx-oci-hooks-2.1.81.0 
TensorFlow                          tensorflow-neuronx-2.10.1.1.0.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.6.5.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.6.5.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.6.5.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.6.5.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.6.5.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.19.0 
PyTorch                             torch-neuronx-1.13.0.1.5.0

Inf2 packages

List of packages in Neuron 2.8.0:

Component                           Package                                           
Collective Communication Library    aws-neuronx-collectives-2.11.47.0 
Driver                              aws-neuronx-dkms-2.7.33.0 
CustomOps                           aws-neuronx-gpsimd-customop-0.1.23.0 
CustomOps Tools                     aws-neuronx-gpsimd-tools-0.1.7.0 
General                             aws-neuronx-runtime-discovery-2.9 
Runtime Library                     aws-neuronx-runtime-lib-2.11.43.0 
System Tools                        aws-neuronx-tools-2.8.2.0 
Framework                           libneuronxla-0.5.144 
Compiler                            neuronx_hwm-2.4.0.1 
PyTorch                             torch_xla-1.13.0 
Compiler                            neuronx-cc-2.4.0.21 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.1.12.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.1.12.0 
OCI Hooks                           aws-neuronx-oci-hooks-2.1.81.0 
TensorFlow                          tensorflow-neuronx-2.10.1.1.0.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.6.5.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.6.5.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.6.5.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.6.5.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.6.5.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.19.0 
PyTorch                             torch-neuronx-1.13.0.1.5.0

Inf1 packages

List of packages in Neuron 2.8.0:

Component                           Package                                           
Driver                              aws-neuronx-dkms-2.7.33.0 
System Tools                        aws-neuronx-tools-2.8.2.0 
Compiler                            neuron-cc-1.13.5.0 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.1.12.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.1.12.0 
OCI Hooks                           aws-neuronx-oci-hooks-2.1.81.0 
TensorFlow                          tensorflow-neuron-1.15.5.2.6.5.0 
TensorFlow                          tensorflow-neuron-2.7.4.2.6.5.0 
TensorFlow                          tensorflow-neuron-2.8.4.2.6.5.0 
TensorFlow                          tensorflow-neuron-2.9.3.2.6.5.0 
TensorFlow                          tensorflow-neuron-2.10.1.2.6.5.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.6.5.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.4.2.6.5.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.4.2.6.5.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.9.3.2.6.5.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.10.1.2.6.5.0 
TensorBoard                         tensorboard-plugin-neuron-2.4.6.0 
PyTorch                             torch-neuron-1.11.0.2.5.8.0 
PyTorch                             torch-neuron-1.12.1.2.5.8.0 
PyTorch                             torch-neuron-1.10.2.2.5.8.0 
PyTorch                             torch-neuron-1.9.1.2.5.8.0 
MXNet                               mxnet_neuron-1.5.1.1.10.11.0 
MXNet                               mx_neuron-1.8.0.2.2.43.0 
Perf Tools                          neuronperf-1.6.1.0 
Runtime Library                     libnrt.so (Version 2.10.30.0)

Neuron 2.7.0 (02/08/2023)

Trn1 packages

List of packages in Neuron 2.7.0:

Component                           Package                                           
Compiler                            neuronx-cc-2.4.0.21 
Kubernetes Plugin                   aws-neuronx-k8-plugin-2.1.12.0 
Kubernetes Scheduler                aws-neuronx-k8-scheduler-2.1.12.0 
OCI Hooks                           aws-neuronx-oci-hooks-2.1.60.0 
TensorFlow                          tensorflow-neuronx-2.8.2.1.2.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-1.15.0.2.5.6.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.5.4.2.5.6.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.6.3.2.5.6.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.7.0.2.5.6.0 
TensorFlow Model Server             tensorflow-model-server-neuronx-2.8.0.2.5.6.0 
TensorBoard                         tensorboard-plugin-neuronx-2.5.15.0 
nan                                 neuronx-gpsimd-customop-0.1.23.0 
nan                                 neuronx-gpsimd-tools-0.1.7.0 
PyTorch                             torch-neuronx-1.13.0.1.4.0 
nan                                 torch-xla-1.13.0 
Driver                              aws-neuronx-dkms-2.7.15.0 
Collective Communication Library    aws-neuronx-collectives-2.11.47.0 
Runtime Library                     aws-neuronx-runtime-lib-2.11.43.0 
System Tools                        aws-neuronx-tools-2.7.2.0

Inf1 packages

List of Neuron packages included in Neuron release version 2.7.0:

driver : 	aws-neuronx-dkms-2.7.15.0
libnrt : 	libnrt.so (version 2.10.27.0)
k8-plugin : 	aws-neuronx-k8-plugin-2.1.12.0
k8-scheduler : 	aws-neuronx-k8-scheduler-2.1.12.0
tools : 	aws-neuronx-tools-2.7.2.0
compiler : 	neuron-cc-1.13.5.0
neuronperf : 	neuronperf-1.6.1.0
pytorch : 	torch-neuron-1.7.1.2.5.8.0
pytorch : 	torch-neuron-1.8.1.2.5.8.0
pytorch : 	torch-neuron-1.9.1.2.5.8.0
pytorch : 	torch-neuron-1.10.2.2.5.8.0
pytorch : 	torch-neuron-1.11.0.2.5.8.0
pytorch : 	torch-neuron-1.12.1.2.5.8.0
tensorflow : 	tensorflow-neuron-1.15.5.2.5.6.0
tensorflow : 	tensorflow-neuron-2.5.3.2.5.6.0
tensorflow : 	tensorflow-neuron-2.6.5.2.5.6.0
tensorflow : 	tensorflow-neuron-2.7.3.2.5.6.0
tensorflow : 	tensorflow-neuron-2.8.2.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-1.15.0.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-2.5.4.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-2.6.3.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-2.7.0.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-2.8.0.2.5.6.0
tensorboard : 	tensorboard-plugin-neuron-2.4.6.0
mxnet : 	mxnet_neuron-1.5.1.1.10.11.0
mxnet : 	mx_neuron-1.8.0.2.2.43.0

Neuron 2.6.0 (12/12/2022)

Trn1 packages

• aws-neuronx-dkms-2.6.33.0

• aws-neuronx-oci-hook-2.1.14.0

• aws-neuronx-runtime-lib-2.10.30.0

• aws-neuronx-collectives-2.10.37.0

• aws-neuronx-tools-2.6.1.0

• aws-neuronx-k8-plugin-2.1.12.0

• aws-neuronx-k8-scheduler-2.1.12.0

• tensorboard_plugin_neuronx-2.5.3.0

• neuronx-cc-2.3.0.4

• torch-neuronx-1.12.0.1.4.0

• tensorflow-model-server-neuronx_1.15.0.2.5.6.0

• tensorflow-model-server-neuronx_2.5.4.2.5.6.0

• tensorflow-model-server-neuronx_2.6.3.2.5.6.0

• tensorflow-model-server-neuronx_2.7.0.2.5.6.0

• tensorflow-model-server-neuronx_2.8.0.2.5.6.0

Inf1 packages

List of Neuron packages included in Neuron release version 2.6.0:

driver : 	aws-neuronx-dkms-2.6.33.0
libnrt : 	libnrt.so (version 2.10.27.0)
k8-plugin : 	aws-neuronx-k8-plugin-2.1.12.0
k8-scheduler : 	aws-neuronx-k8-scheduler-2.1.12.0
tools : 	aws-neuronx-tools-2.6.1.0
compiler : 	neuron-cc-1.13.5.0
neuronperf : 	neuronperf-1.6.1.0
pytorch : 	torch-neuron-1.7.1.2.5.8.0
pytorch : 	torch-neuron-1.8.1.2.5.8.0
pytorch : 	torch-neuron-1.9.1.2.5.8.0
pytorch : 	torch-neuron-1.10.2.2.5.8.0
pytorch : 	torch-neuron-1.11.0.2.5.8.0
pytorch : 	torch-neuron-1.12.1.2.5.8.0
tensorflow : 	tensorflow-neuron-1.15.5.2.5.6.0
tensorflow : 	tensorflow-neuron-2.5.3.2.5.6.0
tensorflow : 	tensorflow-neuron-2.6.5.2.5.6.0
tensorflow : 	tensorflow-neuron-2.7.3.2.5.6.0
tensorflow : 	tensorflow-neuron-2.8.2.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-1.15.0.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-2.5.4.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-2.6.3.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-2.7.0.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-2.8.0.2.5.6.0
tensorboard : 	tensorboard-plugin-neuron-2.4.6.0
mxnet : 	mxnet_neuron-1.5.1.1.10.11.0
mxnet : 	mx_neuron-1.8.0.2.2.43.0

Neuron 2.5.0 (11/23/2022)

Trn1 packages

• aws-neuronx-dkms-2.6.33.0

• aws-neuronx-oci-hook-2.1.14.0

• aws-neuronx-runtime-lib-2.10.27.0

• aws-neuronx-collectives-2.10.34.0

• aws-neuronx-tools-2.5.19.0

• aws-neuronx-k8-plugin-2.1.12.0

• aws-neuronx-k8-scheduler-2.1.12.0

• neuronx-cc-2.2.0.73

• torch-neuronx-1.11.0.1.2.0

• tensorflow-model-server-neuronx_1.15.0.2.5.6.0

• tensorflow-model-server-neuronx_2.5.4.2.5.6.0

• tensorflow-model-server-neuronx_2.6.3.2.5.6.0

• tensorflow-model-server-neuronx_2.7.0.2.5.6.0

• tensorflow-model-server-neuronx_2.8.0.2.5.6.0

Inf1 packages

List of Neuron packages included in Neuron release version 2.5.0:

driver : 	aws-neuronx-dkms-2.6.33.0
libnrt : 	libnrt.so (version 2.10.27.0)
k8-plugin : 	aws-neuronx-k8-plugin-2.1.12.0
k8-scheduler : 	aws-neuronx-k8-scheduler-2.1.12.0
tools : 	aws-neuronx-tools-2.5.19.0
compiler : 	neuron-cc-1.13.5.0
neuronperf : 	neuronperf-1.6.1.0
pytorch : 	torch-neuron-1.7.1.2.5.8.0
pytorch : 	torch-neuron-1.8.1.2.5.8.0
pytorch : 	torch-neuron-1.9.1.2.5.8.0
pytorch : 	torch-neuron-1.10.2.2.5.8.0
pytorch : 	torch-neuron-1.11.0.2.5.8.0
pytorch : 	torch-neuron-1.12.1.2.5.8.0
tensorflow : 	tensorflow-neuron-1.15.5.2.5.6.0
tensorflow : 	tensorflow-neuron-2.5.3.2.5.6.0
tensorflow : 	tensorflow-neuron-2.6.5.2.5.6.0
tensorflow : 	tensorflow-neuron-2.7.3.2.5.6.0
tensorflow : 	tensorflow-neuron-2.8.2.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-1.15.0.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-2.5.4.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-2.6.3.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-2.7.0.2.5.6.0
tensorflow-model-server : 	tensorflow-model-server-neuronx-2.8.0.2.5.6.0
tensorboard : 	tensorboard-plugin-neuron-2.4.6.0
mxnet : 	mxnet_neuron-1.5.1.1.10.11.0
mxnet : 	mx_neuron-1.8.0.2.2.43.0

Neuron 2.4.0 (10/27/2022)

Trn1 packages

• aws-neuronx-dkms-2.6.5.0

• aws-neuronx-oci-hook-2.1.1.0

• aws-neuronx-runtime-lib-2.10.15.0

• aws-neuronx-collectives-2.10.17.0

• aws-neuronx-tools-2.5.16.0

• aws-neuronx-k8-plugin-2.1.2.0

• aws-neuronx-k8-scheduler-2.1.2.0

• neuronx-cc-2.2.0.73

• torch-neuronx-1.11.0.1.2.0

Inf1 packages

List of Neuron packages included in Neuron release version 2.4.0:

driver : 	aws-neuronx-dkms-2.6.5.0
libnrt : 	libnrt.so (version 2.2.51.0)
k8-plugin : 	aws-neuronx-k8-plugin-2.1.2.0
k8-scheduler : 	aws-neuronx-k8-scheduler-2.1.2.0
tools : 	aws-neuron-tools-2.5.16.0
compiler : 	neuron-cc-1.11.7.0
neuronperf : 	neuronperf-1.3.0.0
pytorch : 	torch-neuron-1.7.1.2.3.0.0
pytorch : 	torch-neuron-1.8.1.2.3.0.0
pytorch : 	torch-neuron-1.9.1.2.3.0.0
pytorch : 	torch-neuron-1.10.2.2.3.0.0
pytorch : 	torch-neuron-1.11.0.2.3.0.0
tensorflow : 	tensorflow-neuron-1.15.5.2.3.0.0
tensorflow : 	tensorflow-neuron-2.5.3.2.3.0.0
tensorflow : 	tensorflow-neuron-2.6.3.2.3.0.0
tensorflow : 	tensorflow-neuron-2.7.1.2.3.0.0
tensorflow : 	tensorflow-neuron-2.8.0.2.3.0.0
tensorflow-model-server : 	tensorflow-model-server-neuron-1.15.0.2.3.0.0
tensorflow-model-server : 	tensorflow-model-server-neuron-2.5.4.2.3.0.0
tensorflow-model-server : 	tensorflow-model-server-neuron-2.6.3.2.3.0.0
tensorflow-model-server : 	tensorflow-model-server-neuron-2.7.0.2.3.0.0
tensorflow-model-server : 	tensorflow-model-server-neuron-2.8.0.2.3.0.0
tensorboard : 	tensorboard-plugin-neuron-2.4.0.0
mxnet : 	mxnet_neuron-1.5.1.1.10.0.0
mxnet : 	mx_neuron-1.8.0.2.2.2.0

Neuron 2.3.0 (10/10/2022)

Trn1 packages

• aws-neuronx-dkms-2.5.41.0

• aws-neuronx-oci-hook-2.0.16.0

• aws-neuronx-runtime-lib-2.9.64.0

• aws-neuronx-collectives-2.9.86.0

• aws-neuronx-tools-2.4.14.0

• aws-neuronx-k8-plugin-2.0.1.0

• aws-neuronx-k8-scheduler-2.0.1.0

• neuronx-cc-2.1.0.76

• torch-neuronx-1.11.0.1.1.1

Inf1 packages

List of Neuron packages included in Neuron release version 2.3.0:

driver : 	aws-neuronx-dkms-2.5.41.0
libnrt : 	libnrt.so (version 2.2.51.0)
k8-plugin : 	aws-neuronx-k8-plugin-2.0.1.0
k8-scheduler : 	aws-neuronx-k8-scheduler-2.0.1.0
tools : 	aws-neuron-tools-2.1.4.0
compiler : 	neuron-cc-1.11.7.0
neuronperf : 	neuronperf-1.3.0.0
pytorch : 	torch-neuron-1.7.1.2.3.0.0
pytorch : 	torch-neuron-1.8.1.2.3.0.0
pytorch : 	torch-neuron-1.9.1.2.3.0.0
pytorch : 	torch-neuron-1.10.2.2.3.0.0
pytorch : 	torch-neuron-1.11.0.2.3.0.0
tensorflow : 	tensorflow-neuron-1.15.5.2.3.0.0
tensorflow : 	tensorflow-neuron-2.5.3.2.3.0.0
tensorflow : 	tensorflow-neuron-2.6.3.2.3.0.0
tensorflow : 	tensorflow-neuron-2.7.1.2.3.0.0
tensorflow : 	tensorflow-neuron-2.8.0.2.3.0.0
tensorflow-model-server : 	tensorflow-model-server-neuron-1.15.0.2.3.0.0
tensorflow-model-server : 	tensorflow-model-server-neuron-2.5.4.2.3.0.0
tensorflow-model-server : 	tensorflow-model-server-neuron-2.6.3.2.3.0.0
tensorflow-model-server : 	tensorflow-model-server-neuron-2.7.0.2.3.0.0
tensorflow-model-server : 	tensorflow-model-server-neuron-2.8.0.2.3.0.0
tensorboard : 	tensorboard-plugin-neuron-2.4.0.0
mxnet : 	mxnet_neuron-1.5.1.1.10.0.0
mxnet : 	mx_neuron-1.8.0.2.2.2.0

This document is relevant for: Inf1, Inf2, Trn1, Trn1n