This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3
Release Content#
This page contains the packages, libraries, and other artifacts (and the versions of them) that ship in the latest AWS Neuron SDK release.
Neuron 2.31.0 (07/07/2026)#
Trn1 packages#
List of packages in Neuron 2.31.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.33.10.0
Driver aws-neuronx-dkms-2.29.0.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.23.11.0
CustomOps Tools aws-neuronx-gpsimd-tools-14.09.x
OCI aws-neuronx-oci-hook-2.17.30.0
Runtime Library aws-neuronx-runtime-lib-2.33.10.0
System Tools aws-neuronx-tools-2.31.13.0
Jax jax_neuronx-0.10.0.1.0.10466
Framework libneuronxla-2.2.17544.0
Framework libneuronxla-3.0.3854.0
nan neuron_agentic_development-1.2
Compiler neuronx-cc-2.26.6360.0
Neuron Distributed neuronx_distributed-0.19.28492
Neuron Distributed Inference neuronx_distributed_inference-0.10.18399
NKI nki-0.5.0
TensorBoard tensorboard-plugin-neuronx-2.0.918.0
PyTorch torch-neuronx-2.9.0.2.15.32035
nan torch-xla-2.10.0
nan torch-xla-2.11.0
nan torch-xla-2.12.0
Trn2 packages#
List of packages in Neuron 2.31.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.33.10.0
Driver aws-neuronx-dkms-2.29.0.0
CustomOps Tools aws-neuronx-gpsimd-tools-14.09.x
OCI aws-neuronx-oci-hook-2.17.30.0
Runtime Library aws-neuronx-runtime-lib-2.33.10.0
System Tools aws-neuronx-tools-2.31.13.0
Jax jax_neuronx-0.10.0.1.0.10466
nan libtorch_neuronx_lite-2.10.0.1.0.696
nan libtorch_neuronx_lite-2.11.0.1.0.696
nan libtorch_neuronx_lite-2.12.0.1.0.696
nan neuron_agentic_development-1.2
Compiler neuronx-cc-2.26.6360.0
Neuron Distributed neuronx_distributed-0.19.28492
Neuron Distributed Inference neuronx_distributed_inference-0.10.18399
NKI nki-0.5.0
PyTorch torch-neuronx-2.9.0.2.15.32035
nan torch-xla-2.10.0
nan torch-xla-2.11.0
nan torch-xla-2.12.0
Inf2 packages#
List of packages in Neuron 2.31.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.33.10.0
Driver aws-neuronx-dkms-2.29.0.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.23.11.0
CustomOps Tools aws-neuronx-gpsimd-tools-14.09.x
OCI aws-neuronx-oci-hook-2.17.30.0
Runtime Library aws-neuronx-runtime-lib-2.33.10.0
System Tools aws-neuronx-tools-2.31.13.0
Jax jax_neuronx-0.10.0.1.0.10466
Framework libneuronxla-2.2.17544.0
Framework libneuronxla-3.0.3854.0
nan neuron_agentic_development-1.2
Compiler neuronx-cc-2.26.6360.0
Neuron Distributed neuronx_distributed-0.19.28492
Neuron Distributed Inference neuronx_distributed_inference-0.10.18399
NKI nki-0.5.0
TensorBoard tensorboard-plugin-neuronx-2.0.918.0
PyTorch torch-neuronx-2.9.0.2.15.32035
nan torch-xla-2.10.0
nan torch-xla-2.11.0
nan torch-xla-2.12.0
Inf1 packages#
List of packages in Neuron 2.31.0:
Component Package
OCI aws-neuronx-oci-hook-2.17.30.0
System Tools aws-neuronx-tools-2.31.13.0
MXNet mx_neuron-1.8.0.2.4.147.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.24.0.0
Perf Tools neuronperf-1.8.93.0
PyTorch torch-neuron-1.13.1.2.11.13.0
Supported Python Versions for Inf1 packages#
List of packages in Neuron 2.31.0:
Package Supported Python Versions
mx_neuron-1.8.0.2.4.147.0 3.9, 3.10
mxnet_neuron-1.5.1.1.10.0.0 3.9, 3.10
neuron-cc-1.24.0.0 3.9, 3.10
neuronperf-1.8.93.0 3.9, 3.10
torch-neuron-1.13.1.2.11.13.0 3.9, 3.10
Supported Python Versions for Inf2/Trn1/Trn2 packages#
List of packages in Neuron 2.31.0:
Package Supported Python Versions
jax_neuronx-0.10.0.1.0.10466 3.11, 3.12, 3.13
libneuronxla-2.2.17544.0 3.11, 3.12, 3.13
libneuronxla-3.0.3854.0 3.11, 3.12, 3.13
neuron_agentic_development-1.2 3.11, 3.12, 3.13
neuronx-cc-2.26.6360.0 3.11, 3.12, 3.13
neuronx_distributed-0.19.28492 3.11, 3.12, 3.13
neuronx_distributed_inference-0.10.18399 3.11, 3.12, 3.13
nki-0.5.0 3.11, 3.12, 3.13
torch-neuronx-2.9.0.2.15.32035 3.11, 3.12, 3.13
torch-xla-2.10.0 3.11, 3.12, 3.13
torch-xla-2.11.0 3.11, 3.12, 3.13
torch-xla-2.12.0 3.11, 3.12, 3.13
Supported NumPy Versions#
Neuron currently supports NumPy versions 2.X. Neuron continues to support NumPy versions >= 1.21.6, as well.
Supported vLLM Versions#
Neuron currently supports vLLM version 0.16.0.
Supported Hugging Face Transformers Versions#
Package |
Supported Hugging Face Transformers Versions |
|---|---|
torch-neuronx |
>= 4.52 |
neuronx-distributed-inference |
== 4.57.* |
vllm |
>= 4.56.0, < 5 |
Supported Protobuf Versions#
Package |
Supported Protobuf versions |
|---|---|
neuronx-cc |
> 3 |
torch-neuronx |
>= 3.20 |
jax-neuronx |
>= 3.20 |
torch-neuron |
< 3.20 |
neuronx-distributed |
>= 3.20 |
tensorflow-neuronx |
< 3.20 |
tensorflow-neuron |
< 3.20 |
Previous Neuron Releases Content#
This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3