This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3
Release Content#
This page contains the packages, libraries, and other artifacts (and the versions of them) that ship in the latest AWS Neuron SDK release.
Neuron 2.27.0 (12/19/2025)#
Trn1 packages#
List of packages in Neuron 2.27.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.29.41.0
Driver aws-neuronx-dkms-2.25.4.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.19.2.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.19.1.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.29.16.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.29.16.0
OCI aws-neuronx-oci-hook-2.13.52.0
Runtime Library aws-neuronx-runtime-lib-2.29.40.0
System Tools aws-neuronx-tools-2.27.33.0
Jax jax_neuronx-0.7.0.1.0.7377
Framework libneuronxla-2.2.14584.0
Compiler neuronx-cc-2.22.12471.0
Compiler neuronx-cc-stubs-2.22.12471.0
Neuron Distributed neuronx_distributed-0.16.25997
Neuron Distributed Training neuronx_distributed_training-1.7.0
Neuron Distributed Inference neuronx_distributed_inference-0.7.14366
nki nki-0.1.0
TensorBoard tensorboard-plugin-neuronx-2.0.918.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
PyTorch torch-neuronx-2.9.0.2.11.19912
PyTorch torch-neuronx-2.7.0.2.11.19912
PyTorch torch-neuronx-2.8.0.2.11.19912
Trn2 packages#
List of packages in Neuron 2.27.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.29.41.0
Driver aws-neuronx-dkms-2.25.4.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.19.2.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.19.1.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.29.16.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.29.16.0
OCI aws-neuronx-oci-hook-2.13.52.0
Runtime Library aws-neuronx-runtime-lib-2.29.40.0
System Tools aws-neuronx-tools-2.27.33.0
Compiler neuronx-cc-2.22.12471.0
Compiler neuronx-cc-stubs-2.22.12471.0
Neuron Distributed neuronx_distributed-0.16.25997
Neuron Distributed Training neuronx_distributed_training-1.7.0
Neuron Distributed Inference neuronx_distributed_inference-0.7.14366
nki nki-0.1.0
PyTorch torch-neuronx-2.9.0.2.11.19912
PyTorch torch-neuronx-2.7.0.2.11.19912
PyTorch torch-neuronx-2.8.0.2.11.19912
Inf2 packages#
List of packages in Neuron 2.27.0:
Component Package
Collective Communication Library aws-neuronx-collectives-2.29.41.0
Driver aws-neuronx-dkms-2.25.4.0
CustomOps aws-neuronx-gpsimd-customop-lib-0.19.2.0
CustomOps Tools aws-neuronx-gpsimd-tools-0.19.1.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.29.16.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.29.16.0
OCI aws-neuronx-oci-hook-2.13.52.0
Runtime Library aws-neuronx-runtime-lib-2.29.40.0
System Tools aws-neuronx-tools-2.27.33.0
Jax jax_neuronx-0.7.0.1.0.7377
Framework libneuronxla-2.2.14584.0
Compiler neuronx-cc-2.22.12471.0
Compiler neuronx-cc-stubs-2.22.12471.0
Neuron Distributed neuronx_distributed-0.16.25997
Neuron Distributed Inference neuronx_distributed_inference-0.7.14366
nki nki-0.1.0
TensorBoard tensorboard-plugin-neuronx-2.0.918.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuronx-2.10.1.2.1.0
PyTorch torch-neuronx-2.9.0.2.11.19912
PyTorch torch-neuronx-2.7.0.2.11.19912
PyTorch torch-neuronx-2.8.0.2.11.19912
Inf1 packages#
List of packages in Neuron 2.27.0:
Component Package
Driver aws-neuronx-dkms-2.25.4.0
Kubernetes Plugin aws-neuronx-k8-plugin-2.29.16.0
Kubernetes Scheduler aws-neuronx-k8-scheduler-2.29.16.0
OCI aws-neuronx-oci-hook-2.13.52.0
System Tools aws-neuronx-tools-2.27.33.0
MXNet mx_neuron-1.8.0.2.4.147.0
MXNet mxnet_neuron-1.5.1.1.10.0.0
Compiler neuron-cc-1.24.0.0
Perf Tools neuronperf-1.8.93.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.10.1.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.9.3.2.12.2.0
TensorFlow Model Server tensorflow-model-server-neuronx-2.8.4.2.12.2.0
TensorFlow tensorflow-neuron-2.10.1.2.12.2.0
PyTorch torch-neuron-1.13.1.2.11.13.0
Supported Python Versions for Inf1 packages#
List of packages in Neuron 2.27.0:
Package Supported Python Versions
mx_neuron-1.8.0.2.4.147.0 3.9, 3.10
mxnet_neuron-1.5.1.1.10.0.0 3.9, 3.10
neuron-cc-1.24.0.0 3.9, 3.10
neuronperf-1.8.93.0 3.9, 3.10
tensorflow-neuron-2.10.1.2.12.2.0 3.9, 3.10
torch-neuron-1.13.1.2.11.13.0 3.9, 3.10
Supported Python Versions for Inf2/Trn1/Trn2 packages#
List of packages in Neuron 2.27.0:
Package Supported Python Versions
jax_neuronx-0.7.0.1.0.7377 3.10, 3.11, 3.12
libneuronxla-2.2.14584.0 3.10, 3.11, 3.12
neuronx-cc-2.22.12471.0 3.10, 3.11, 3.12
neuronx-cc-stubs-2.22.12471.0 3.10, 3.11, 3.12
neuronx_distributed-0.16.25997 3.10, 3.11, 3.12
neuronx_distributed_inference-0.7.14366 3.10, 3.11, 3.12
nki-0.1.0 3.10, 3.11, 3.12
tensorflow-neuronx-2.10.1.2.1.0 3.10, 3.11, 3.12
torch-neuronx-2.9.0.2.11.19912 3.10, 3.11, 3.12
torch-neuronx-2.7.0.2.11.19912 3.10, 3.11
torch-neuronx-2.8.0.2.11.19912 3.10, 3.11, 3.12
Supported NumPy Versions#
Neuron supports versions >= 1.21.6 and <= 1.22.2
Supported Hugging Face Transformers Versions#
Package |
Supported Hugging Face Transformers Versions |
|---|---|
torch-neuronx |
< 4.35 and >=4.37.2 |
transformers-neuronx |
>= 4.36.0 |
neuronx-distributed - Llama model class |
4.31 |
neuronx-distributed - GPT NeoX model class |
4.26 |
neuronx-distributed - Bert model class |
4.26 |
nemo-megatron |
4.31.0 |
Supported Protobuf Versions#
Package |
Supported Protobuf versions |
|---|---|
neuronx-cc |
> 3 |
torch-neuronx |
>= 3.20 |
torch-neuron |
< 3.20 |
transformers-neuronx |
>= 3.20 |
neuronx-distributed |
>= 3.20 |
tensorflow-neuronx |
< 3.20 |
tensorflow-neuron |
< 3.20 |
Previous Neuron Releases Content#
This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3