This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3
Release content#
This page contains the packages, libraries, and other artifacts (and the versions of them) that ship in the latest AWS Neuron SDK release.
Neuron 2.33.0 (10/19/2026)#
Trn1 packages#
List of packages in Neuron 2.33.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.35.43.0
Driver aws-neuronx-dkms-2.31.7.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.25.12.0
CustomOps Tools aws-neuronx-gpsimd-tools-14.09.x
OCI aws-neuronx-oci-hook-2.19.65.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.35.30.0
System Tools aws-neuronx-tools-2.33.38.0
Jax jax_neuronx-0.10.0.1.0.14198
Framework libneuronxla-3.0.10135.0
Neuron Agentic Development neuron_agentic_development-1.4
Compiler neuronx-cc-2.28.7631.0
NKI nki-0.7.0
nrtpy nrtpy-2.35.30
Torch Neuron (native PyTorch) torch-neuronx-2.9.0.2.15.32035
PyTorch torch-xla-2.11.0
PyTorch torch-xla-2.12.0
PyTorch torch-xla-2.13.0
Trn1 supported Python versions#
List of packages in Neuron 2.33.0:
Package Supported Python Versions
jax_neuronx-0.10.0.1.0.14198 3.11, 3.12, 3.13, 3.14
libneuronxla-3.0.10135.0 3.11, 3.12, 3.13, 3.14
neuron_agentic_development-1.4 3.11, 3.12, 3.13, 3.14
neuronx-cc-2.28.7631.0 3.11, 3.12, 3.13, 3.14
nki-0.7.0 3.11, 3.12, 3.13, 3.14
nrtpy-2.35.30 3.11, 3.12, 3.13, 3.14
torch-neuronx-2.9.0.2.15.32035 3.11, 3.12, 3.13
torch-xla-2.11.0 3.11, 3.12, 3.13, 3.14
torch-xla-2.12.0 3.11, 3.12, 3.13, 3.14
torch-xla-2.13.0 3.11, 3.12, 3.13, 3.14
Trn2 packages#
List of packages in Neuron 2.33.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.35.43.0
Driver aws-neuronx-dkms-2.31.7.0
CustomOps Tools aws-neuronx-gpsimd-tools-14.09.x
OCI aws-neuronx-oci-hook-2.19.65.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.35.30.0
System Tools aws-neuronx-tools-2.33.38.0
Jax jax_neuronx-0.10.0.1.0.14198
PyTorch libtorch_neuronx_lite-2.11.0.1.0.3112
PyTorch libtorch_neuronx_lite-2.12.0.1.0.3112
PyTorch libtorch_neuronx_lite-2.13.0.1.0.3112
Neuron Agentic Development neuron_agentic_development-1.4
Compiler neuronx-cc-2.28.7631.0
NKI nki-0.7.0
nrtpy nrtpy-2.35.30
Torch Neuron (native PyTorch) torch-neuronx-2.9.0.2.15.32035
Torch Neuron (native PyTorch) torch-neuronx-2.13.3.0
Torch Neuron (native PyTorch) torch-neuronx-2.14.3.0
PyTorch torch-xla-2.11.0
PyTorch torch-xla-2.12.0
PyTorch torch-xla-2.13.0
PyTorch torchtitan-0.2.2+neuron.1
vllm-neuron vllm-neuron-0.29.0.1.2.0
vllm-omni-neuron vllm-omni-neuron-0.29.0.0.2.0
Trn2 supported Python versions#
List of packages in Neuron 2.33.0:
Package Supported Python Versions
jax_neuronx-0.10.0.1.0.14198 3.11, 3.12, 3.13, 3.14
libtorch_neuronx_lite-2.11.0.1.0.3112 3.11, 3.12, 3.13, 3.14
libtorch_neuronx_lite-2.12.0.1.0.3112 3.11, 3.12, 3.13, 3.14
libtorch_neuronx_lite-2.13.0.1.0.3112 3.11, 3.12, 3.13, 3.14
neuron_agentic_development-1.4 3.11, 3.12, 3.13, 3.14
neuronx-cc-2.28.7631.0 3.11, 3.12, 3.13, 3.14
nki-0.7.0 3.11, 3.12, 3.13, 3.14
nrtpy-2.35.30 3.11, 3.12, 3.13, 3.14
torch-neuronx-2.9.0.2.15.32035 3.11, 3.12, 3.13
torch-neuronx-2.13.3.0 3.12, 3.13, 3.14
torch-neuronx-2.14.3.0 3.12, 3.13, 3.14
torch-xla-2.11.0 3.11, 3.12, 3.13, 3.14
torch-xla-2.12.0 3.11, 3.12, 3.13, 3.14
torch-xla-2.13.0 3.11, 3.12, 3.13, 3.14
torchtitan-0.2.2+neuron.1 3.12, 3.13, 3.14
vllm-neuron-0.29.0.1.2.0 3.11, 3.12, 3.13, 3.14
vllm-omni-neuron-0.29.0.0.2.0 3.11, 3.12, 3.13, 3.14
Trn3 packages#
List of packages in Neuron 2.33.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.35.43.0
Driver aws-neuronx-dkms-2.31.7.0
CustomOps Tools aws-neuronx-gpsimd-tools-14.09.x
OCI aws-neuronx-oci-hook-2.19.65.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.35.30.0
System Tools aws-neuronx-tools-2.33.38.0
Jax jax_neuronx-0.10.0.1.0.14198
PyTorch libtorch_neuronx_lite-2.11.0.1.0.3112
PyTorch libtorch_neuronx_lite-2.12.0.1.0.3112
PyTorch libtorch_neuronx_lite-2.13.0.1.0.3112
Neuron Agentic Development neuron_agentic_development-1.4
Compiler neuronx-cc-2.28.7631.0
NKI nki-0.7.0
nrtpy nrtpy-2.35.30
Torch Neuron (native PyTorch) torch-neuronx-2.9.0.2.15.32035
Torch Neuron (native PyTorch) torch-neuronx-2.13.3.0
Torch Neuron (native PyTorch) torch-neuronx-2.14.3.0
PyTorch torch-xla-2.11.0
PyTorch torch-xla-2.12.0
PyTorch torch-xla-2.13.0
PyTorch torchtitan-0.2.2+neuron.1
vllm-neuron vllm-neuron-0.29.0.1.2.0
vllm-omni-neuron vllm-omni-neuron-0.29.0.0.2.0
Trn3 supported Python versions#
List of packages in Neuron 2.33.0:
Package Supported Python Versions
jax_neuronx-0.10.0.1.0.14198 3.11, 3.12, 3.13, 3.14
libtorch_neuronx_lite-2.11.0.1.0.3112 3.11, 3.12, 3.13, 3.14
libtorch_neuronx_lite-2.12.0.1.0.3112 3.11, 3.12, 3.13, 3.14
libtorch_neuronx_lite-2.13.0.1.0.3112 3.11, 3.12, 3.13, 3.14
neuron_agentic_development-1.4 3.11, 3.12, 3.13, 3.14
neuronx-cc-2.28.7631.0 3.11, 3.12, 3.13, 3.14
nki-0.7.0 3.11, 3.12, 3.13, 3.14
nrtpy-2.35.30 3.11, 3.12, 3.13, 3.14
torch-neuronx-2.9.0.2.15.32035 3.11, 3.12, 3.13
torch-neuronx-2.13.3.0 3.12, 3.13, 3.14
torch-neuronx-2.14.3.0 3.12, 3.13, 3.14
torch-xla-2.11.0 3.11, 3.12, 3.13, 3.14
torch-xla-2.12.0 3.11, 3.12, 3.13, 3.14
torch-xla-2.13.0 3.11, 3.12, 3.13, 3.14
torchtitan-0.2.2+neuron.1 3.12, 3.13, 3.14
vllm-neuron-0.29.0.1.2.0 3.11, 3.12, 3.13, 3.14
vllm-omni-neuron-0.29.0.0.2.0 3.11, 3.12, 3.13, 3.14
Inf2 packages#
List of packages in Neuron 2.33.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.35.43.0
Driver aws-neuronx-dkms-2.31.7.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.25.12.0
CustomOps Tools aws-neuronx-gpsimd-tools-14.09.x
OCI aws-neuronx-oci-hook-2.19.65.0
General aws-neuronx-runtime-discovery-2.9
Runtime Library aws-neuronx-runtime-lib-2.35.30.0
System Tools aws-neuronx-tools-2.33.38.0
Jax jax_neuronx-0.10.0.1.0.14198
Framework libneuronxla-3.0.10135.0
Neuron Agentic Development neuron_agentic_development-1.4
Compiler neuronx-cc-2.28.7631.0
NKI nki-0.7.0
nrtpy nrtpy-2.35.30
Torch Neuron (native PyTorch) torch-neuronx-2.9.0.2.15.32035
PyTorch torch-xla-2.11.0
PyTorch torch-xla-2.12.0
PyTorch torch-xla-2.13.0
Inf2 supported Python versions#
List of packages in Neuron 2.33.0:
Package Supported Python Versions
jax_neuronx-0.10.0.1.0.14198 3.11, 3.12, 3.13, 3.14
libneuronxla-3.0.10135.0 3.11, 3.12, 3.13, 3.14
neuron_agentic_development-1.4 3.11, 3.12, 3.13, 3.14
neuronx-cc-2.28.7631.0 3.11, 3.12, 3.13, 3.14
nki-0.7.0 3.11, 3.12, 3.13, 3.14
nrtpy-2.35.30 3.11, 3.12, 3.13, 3.14
torch-neuronx-2.9.0.2.15.32035 3.11, 3.12, 3.13
torch-xla-2.11.0 3.11, 3.12, 3.13, 3.14
torch-xla-2.12.0 3.11, 3.12, 3.13, 3.14
torch-xla-2.13.0 3.11, 3.12, 3.13, 3.14
Supported NumPy versions#
Neuron currently supports NumPy versions 2.X. Neuron continues to support NumPy versions >= 1.21.6, as well.
Supported vLLM versions#
Neuron currently supports vLLM version 0.29.0. Both vLLM Neuron (vllm-neuron 0.29.0.1.2.0) and vLLM Omni Neuron (vllm-omni-neuron 0.29.0.0.2.0) are built on vLLM 0.29.0.
Supported Hugging Face Transformers versions#
Package |
Supported Hugging Face Transformers versions |
|---|---|
torch-neuronx |
>= 4.52 |
vllm |
>= 4.56.0, < 5 |
Supported Protobuf versions#
Package |
Supported Protobuf versions |
|---|---|
neuronx-cc |
> 3 |
torch-neuronx |
>= 3.20 |
jax-neuronx |
>= 3.20 |
Previous Neuron releases content#
This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3