All Posts

Announcing changes to NxDI in the upcoming releases

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

As part of our transition to native PyTorch support, we are simplifying NxDI to provide a more streamlined developer experience.

Read more ...

Neuron no longer supports Inf1 virtual environments and AMIs starting with Neuron 2.27

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.27, Neuron no longer supports Inf1 virtual environments and AMIs. If you are a customer who is currently using Inf1 virtual environments or AMIs, use Neuron DLAMIs with Neuron version 2.26.1 or earlier.

Read more ...

Announcing End of Support for Ubuntu 22.04 single framework DLAMIs for PyTorch and JAX in future release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Ubuntu 22.04 single framework DLAMIs for PyTorch and JAX will reach end of support in a future release. Customers are advised to use multi-framework or previously released DLAMIs for Ubuntu 22.04.

Read more ...

Neuron no longer supports tensorflow_2_10 single framework DLAMI and virtual environment in multi-framework DLAMIs starting with Neuron 2.27

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with the release of Neuron 2.27.0, the tensorflow_2_10 single framework Deep Learning AMI (DLAMI) and the TensorFlow 2.10 virtual environment in multi-framework DLAMIs are no longer supported.

Read more ...

Neuron no longer supports parallel_model_trace API starting with Neuron 2.27

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with the Neuron 2.27 release, the parallel_model_trace API is no longer supported for inference. We introduced the Model Builder V2 API in Neuron 2.25 as an alternative to the tracing API, and it is now the default API in Neuron for model tracing.

Read more ...

Neuron no longer supports Python 3.9 starting with Neuron version 2.27

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.27, Neuron no longer includes support for Python 3.9 as it has reached its end-of-life status.

Read more ...

Neuron no longer supports PyTorch 2.6 starting with Neuron 2.27

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron 2.27, Neuron no longer supports PyTorch 2.6. We recommend that all customers using PyTorch 2.6 to upgrade to the latest supported PyTorch version.

Read more ...

End of Support for PyTorch Experimental Profiling API starting in a future release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron will end support for the torch_neuronx.experimental.profiler.profile API in a future release of Neuron (planned for v2.29.0). This experimental API will be replaced by native PyTorch profiling support using the standard torch.profiler.profile() API.

Read more ...

End of Support for Neuron Profiler and Neuron Profiler 2.0 UI and CLI coming in a future Neuron release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron will end support for the legacy Neuron Profiler and Neuron Profiler 2.0 UI and CLI tools in a coming release (planned for v2.29.0). We launched Neuron Explorer in Neuron SDK 2.27, replacing these tools with a unified developer experience that will include device and system profiling in a single view, eager mode support, enhanced memory profiling, improved visualization capabilities, as well as support for the full developer lifecycle.

Read more ...

Announcing Transition to PyTorch Native Support for AWS Trainium in the Next Neuron Release Supporting PyTorch 2.10

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with the introduction of Neuron support for PyTorch 2.10, AWS Neuron will begin a transition from PyTorch/XLA to native PyTorch support via TorchNeuron. PyTorch 2.9 will be the last version based on PyTorch/XLA.

Read more ...

Announcing NKI Library Namespace Changes in Neuron 2.28

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

NKI Library kernels are published in the NKI Library GitHub repository. In Neuron 2.27, these kernels are also shipped as part of neuronx-cc using the nkilib.* namespace. To avoid namespace conflicts when customers use kernels from the open source repository, the repository uses the nkilib_standalone.nkilib.* namespace.

Read more ...

Announcing NKI Library Kernel Migration to New nki.* Namespace in Neuron 2.28

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Some NKI Library kernels currently use the legacy neuronxcc.nki.* namespace. Starting with Neuron 2.28, all NKI Library kernels will migrate to the new nki.* namespace.

Read more ...

Announcing End of Support for vLLM V0 starting with Neuron 2.28

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron Release 2.27 will be the last release to support vLLM V0. In Neuron 2.27 release, vLLM V1 support is introduced for Neuron using the vllm-neuron plugin. Review the sources in the Neuron vLLM GitHub Repository.

Read more ...

Announcing End of Support for neuronxcc.nki Namespace Starting with Neuron 2.28

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron 2.27 will be the last to include support for the neuronxcc.nki.* namespace. Starting with Neuron 2.28, this namespace will no longer be supported.

Read more ...

Announcing End of Support for TensorBoard Plugin for Neuron Profiler in Neuron 2.27

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron 2.27 will be the last release to support TensorBoard Plugin. Future Neuron releases will not include the support for TensorBoard plugin. All customers using the TensorBoard plugin to visualize and analyze model performance are recommended to migrate to Neuron Explorer.

Read more ...

Announcing End of Support for NxDT and NxD Core Training APIs Starting with PyTorch 2.10

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron support for PyTorch 2.9 will be the last to include the NeuronX Distributed Training (NxDT) libraries, NxD Core training APIs, and PyTorch/XLA for training. Starting with Neuron support for PyTorch 2.10, these components will no longer be supported.

Read more ...

Announcing the deprecation of the NeuronX Deep Learning Inference API path_trace function

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.26.0 is the last release supporting parallel_model_trace. This NxD Inference function will be deprecated in the next version of the Neuron SDK in favor of the ModelBuilder.trace() method, which provides a more robust and flexible approach for tracing and compiling models for Neuron devices, enabling more advanced features such as weight layout optimization support, as well as other quality-of-life and stability improvements for SPMD tracing.

Read more ...

Announcing End of Support for PyTorch NeuronX version 2.6 starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.26 will be the last release that will include support for PyTorch NeuronX version 2.6. Future Neuron releases will not include support for PyTorch NeuronX version 2.6. Current users of PyTorch NeuronX version 2.6 are advised to upgrade to PyTorch NeuronX 2.7 or 2.8. See Neuron release artifacts for more details on supported versions.

Read more ...

Upcoming changes to Neuron driver 2.21 support for Inf1 starting Neuron 2.26 release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.26, Neuron driver versions above 2.21 will only support non-Inf1 instances (such as Trn1, Inf2, or other instance types). For Inf1 instance users, Neuron driver versions < 2.21 will remain supported with regular security patches.

Read more ...

Neuron no longer supports nki_jit API in PyTorch Neuron starting this release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.24, torch_neuronx.nki_jit API in torch-neuronx package is no longer supported.

Read more ...

Announcing end of support for Transformers NeuronX library starting in Neuron 2.26 release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting from Neuron Release 2.24, Transformers NeuronX library is in maintenance mode. transformers-neuronx releases will now only address critical security issues. In Neuron Release 2.26, Neuron will end support for transformers-neuronx.

Read more ...

Announcing end of support for NKI block dimension starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.24 will be the last release to include support for the NKI block dimension in NKI tensor creation routines. Starting with this release, using the block dimension will generate EOS warnings. In the next release (Neuron Release 2.25), these warnings will be upgraded to errors.

Read more ...

Announcing end of support for Llama 3.2 Meta checkpoint

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.24, the mllama 3.2 Meta checkpoint API is no longer be supported.

Read more ...

Announcing end of support for Beta PyTorch NeuronCore Placement APIs starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron Release 2.24 is the last release to support the Beta PyTorch NeuronCore Placement APIs.

Read more ...

Announcing end of support XLA_USE_BF16 and XLA_DOWNCAST_BF16 environment variables starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron Release 2.24 will be the last release to support the following environment variables:

Read more ...

Announcing End of Support for Tensorflow Neuron Inf1 SSD300 tutorial starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.24 will be the last release that will include support for Tensorflow Neuron Inf1 SSD300 tutorial. Future Neuron releases will not include support for Tensorflow Neuron Inf1 SSD300 tutorial due to security issues.

Read more ...

Announcing End of Support for PyTorch NeuronX version 2.5 starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.24 will be the last release that will include support for PyTorch NeuronX version 2.5. Future Neuron releases will not include support for PyTorch NeuronX version 2.5.

Read more ...

Neuron no longer supports jax_neuronx.nki_call API in jax-neuronx starting this release

  • 15 May 2025
  • en

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron Release 2.23 no longer supports jax_neuronx.nki_call API in jax-neuronx package.

Read more ...

Neuron no longer supports base Ubuntu 20 operating system starting this release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron Release 2.23 no longer includes support for base Ubuntu 20.04 operating system.

Read more ...

Neuron no longer supports Tensorflow 2.8 and 2.9 starting this release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.23, Neuron no longer supports for TensorFlow-Neuron 2.8 and 2.9 versions.

Read more ...

Neuron no longer supports NeMo Megatron starting this release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.23, Neuron no longer supports NeMo Megatron.

Read more ...

Announcing migration of NxD Core inference examples from NxD Core repository to NxD Inference repository starting this release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.23, the following models and modules in NxD Core inference examples are now only available through NxD Inference package:

Read more ...

Announcing maintenance mode for Transformers NeuronX library starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting from Neuron release 2.24, Transformers NeuronX library is entering maintenance mode. Future releases of transformers-neuronx will address critical security issues only and we will gradually end support.

Read more ...

Announcing end of support for torch_neuronx.nki_jit API in torch-neuronx starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron Release 2.23 will be the last release to include support for torch_neuronx.nki_jit API in torch-neuronx package.

Read more ...

Announcing end of support for mllama 3.2 Meta Checkpoint API starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron Release 2.23 will be the last release to include support for the mllama 3.2 Meta checkpoint API. In the next release (Neuron 2.24), Neuron will end support.

Read more ...

Announcing end of support for XLA_USE_BF16 and XLA_DOWNCAST_BF16 starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.23, Neuron will begin phasing out support for the XLA_DOWNCAST_BF16 and XLA_USE_BF16 environment variables. In this release, usage of these variables will trigger warnings. Neuron will end support in a subsequent release, aligned with the torch-xla maintenance schedule.

Read more ...

Neuron no longer supports PyTorch 2.1 starting this release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.22, Neuron no longer includes support for PyTorch 2.1, its associated Deep Learning Containers (DLCs), and Deep Learning AMIs (DLAMIS).

Read more ...

Neuron no longer supports PyTorch 1.13 starting this release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.22, Neuron no longer supports PyTorch 1.13, its associated Deep Learning Containers (DLCs), and Deep Learning AMIs (DLAMIS) for Trn1, Trn2, and Inf2 instances.

Read more ...

Neuron no longer includes support for Ubuntu20 DLCs and DLAMIs starting this release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.22, Neuron no longer includes offerings for Ubuntu20 Deep Learning Containers (DLCs) and Deep Learning AMIs (DLAMIs).

Read more ...

Neuron no longer includes support for Neuron DET tool starting with this release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.22, Neuron no longer supports the Neuron Distributed Event Tracing (NDET/neuron-det) tool.

Read more ...

Neuron no longer includes Python 3.8 support starting this release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.22, Neuron no longer includes support for Python 3.8 as it has its reached end-of-life status.

Read more ...

Announcing end of support for jax_neuronx.nki_call API in jax-neuronx from starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.23, Neuron will end support for jax_neuronx.nki_call API in jax-neuronx package.

Read more ...

Announcing end of support for Tensorflow 2.8 and 2.9 starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.23, Neuron will end support for TensorFlow 2.8 and 2.9. Future Neuron releases will not include support for Tensorflow-Neuron 2.8 and 2.9 versions.

Read more ...

Announcing end of support for Neuron support for NeMo Megatron starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.23, Neuron will end support for NeMo Megatron.

Read more ...

PyTorch Neuron versions 1.9 and 1.10 no longer supported

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.21, Neuron no longer supports torch-neuron 1.9 and 1.10 versions. Current users of torch-neuron 1.9 and 1.10 versions are advised to migrate to the latest torch-neuron supported version. Please see Release Content.

Read more ...

Announcing migration of NxD Core examples from NxD Core repository to NxD Inference repository in next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron Release 2.21 will be the last release to include NxD Core repository inference examples under the NxD Core repository: aws-neuron/neuronx-distributed. Starting with Neuron Release 2.21, the models and modules in NxD Core inference examples are now available through NxD Inference package. We recommend customers to update their applications to use examples from the NxD Inference repository. See NxD Inference Overview

Read more ...

Announcing end of support for Ubuntu20 DLCs and DLAMIs

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron Release 2.21, AWS Neuron will begin phasing out support for Ubuntu20 Deep Learning Containers (DLCs) and Deep Learning AMIs (DLAMIs). Neuron 2.21 will be the last release to provide bug fixes, and by Neuron 2.22, these offerings will no longer be available.

Read more ...

Announcing end of support for Python 3.8 in future releases

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Due to Python 3.8 reaching its end-of-life status, future Neuron releases will no longer include support for this version.

Read more ...

Announcing end of support for PyTorch 2.1 starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron Release 2.21 is the last release to support PyTorch 2.1, its associated Deep Learning Containers (DLCs), and Deep Learning AMIs (DLAMIS).

Read more ...

Announcing end of support for PyTorch 1.13 starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron Release 2.21 is the last release to support PyTorch 1.13, its associated Deep Learning Containers (DLCs), and Deep Learning AMIs (DLAMIS) for Trn1, Trn2, and Inf2 instances.

Read more ...

Announcing end of support for Neuron DET tool starting next release

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron Release 2.21 will be the last release to support the Neuron Distributed Event Tracing (NDET/neuron-det) tool.

Read more ...

‘neurondevice’ resource name in Neuron Device K8s plugin no longer supported

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.20, Neuron no longer supports resource name ‘neurondevice’.

Read more ...

‘neuron-device-version’ field in neuron-monitor no longer supported

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.20, Neuron no longer supports the field ‘neuron-device-version’ in neuron-monitor.

Read more ...

Tensorflow-Neuron 1.x no longer supported

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.20, Neuron no longer supports Tensorflow-Neuron 1.x. Current users of those versions are advised to migrate to latest tensorflow-neuron version 2.10.1. Please see TensorFlow Neuron for more details.

Read more ...

Neuron Runtime no longer supports Amazon Linux 2 (AL2)

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting from Neuron release 2.20, the Neuron Runtime (aws-neuronx-runtime-lib) will no longer support Amazon Linux 2 (AL2). The Neuron Driver (aws-neuronx-dkms) is now the only Neuron package that supports Amazon Linux 2.

Read more ...

Announcing maintenance mode for torch-neuron 1.9 and 1.10 versions

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.20, torch-neuron 1.9 and 1.10 versions will enter maintenance mode. Future Neuron releases will not include support for torch-neuron 1.9 and 1.10 versions. Current users of torch-neuron 1.9 and 1.10 versions are advised to migrate to torch-neuron 1.13.

Read more ...

Announcing Name Change for Neuron Component

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.20, the name of the following Neuron component will change as follows:

Read more ...

Neuron support for MxNet enters maintenance mode

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.19, Neuron support for MxNet (mxnet-neuron) is entering maintenance mode.

Read more ...

Announcing end of support for ‘neurondevice’ resource name in Neuron Device K8s plugin

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.19 will be the last release to include resource name ‘neurondevice’.

Read more ...

Announcing end of support for ‘neuron-device-version’ field in neuron-monitor

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.19 will be the last release to include the field ‘neuron-device-version’ in neuron-monitor.

Read more ...

Announcing end of support for Tensorflow-Neuron 1.x

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.19 will be the last release to support Tensorflow-Neuron 1.x. Future Neuron releases will not include support for Tensorflow-Neuron 1.x versions. Current users of those versions are advised to migrate to latest tensorflow-neuron version 2.10.1.

Read more ...

Announcing end of support for Probuf versions <= 3.19 for PyTorch NeuronX, NeuronX Distributed, and Transformers NeuronX libraries

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.19 will be the last release that will include Probuf <= 3.19 support for PyTorch NeuronX, NeuronX Distributed, and Transformers NeuronX libraries. Future Neuron releases will not include Probuf <= 3.19 support for PyTorch NeuronX.

Read more ...

Announcing end of support for Neuron Runtime support of Amazon Linux 2 (AL2)

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.19 will be the last release that will include Neuron Runtime support for Amazon Linux 2 . Future Neuron releases will not include Neuron Runtime support for Amazon Linux 2.

Read more ...

Announcing end of support for Neuron virtual environments in AWS Deep Learning AMI (Amazon Linux 2)

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.18.2 will be the last release that will include support for the following virtual environments in AWS Deep Learning AMI (Amazon Linux 2):

Read more ...

Announcing end of support for Neuron Release 2.18.0 Deep Learning AMIs

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

We are announcing end of support for Neuron release 2.18.0 Deep Learning AMIs. DLAMIs released between March 26,2024 (2024-03-26) and April 10, 2024 (2024-04-10) were shipped without the audit package. The following are the affected DLAMIs:

Read more ...

Tensorflow-Neuron 1.x enters maintenance mode

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.18, Tensorflow-Neuron 1.x is entering maintenance mode. Future releases of Tensorflow-Neuron 1.x will address critical security issues only and we will gradually end support. Current users of those versions are advised to migrate to latest tensorflow-neuron version 2.10.1.

Read more ...

PyTorch NeuronX version 2.0 (Beta) no longer supported

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.17 no longer supports PyTorch NeuronX version 2.0 (Beta).

Read more ...

Announcing Name Change for Neuron Components

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.16, the name of the following Neuron components will change as follows:

Read more ...

Announcing end-of-support for NeuronX Distributed Training Samples in Neuron Samples Repository

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.16 will be the last release to include support for NeuronX Distributed Training Samples (Llama-2, GPT-NeoX 20B, and GPT-NeoX 6.9B) under the AWS Neuron Samples Github repository.

Read more ...

Announcing end-of-support for Neuron Containers with Runtime 1.x

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.3 was the last release to support Neuron Runtime 1.x (neuron-rtd). Current users of Neuron DLC/DLAMI with Neuron Runtime 1.x are required to update their image to support latest Neuron Runtime versions. For instructions, see the Setup Guide.

Read more ...

Announcing End of Support for PyTorch NeuronX version 2.0 (beta)

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.16 will be the last release that will include beta support for PyTorch NeuronX version 2.0 (beta). Future Neuron releases will not include support for PyTorch NeuronX version 2.0.

Read more ...

Announcing End of Support for PyTorch Neuron version 1.10

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.16 will be the last release that will include support for PyTorch Neuron version 1.10. Future Neuron releases will not include support for PyTorch Neuron version 1.10.

Read more ...

Announcing End of Support for nemo option-argument

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.15 will be the last release that will include support for nemo option-argument in the existing –distribution_strategy compiler option. Future releases will not include Neuron support for nemo option-argument. Users are advised to migrate to the new llm-training option-argument.

Read more ...

Announcing End Of Support for OPT example in Transformers NeuronX

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.15 will be the last release that will include OPT example in Transformers NeuronX.

Read more ...

Announcing end-of-support for --model-type=transformer-inference compiler flag

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.14, the --model-type=transformer-inference compiler flag is deprecated.

Read more ...

Announcing end of support for torch-neuron version 1.9

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.13 will be the last release that will include support for torch-neuron version 1.9. Future Neuron releases will not include support for torch-neuron version 1.9.

Read more ...

AWS Neuron reference for Megatron-LM no longer supported

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.13 no longer includes support for AWS Neuron reference for Megatron-LM.

Read more ...

Announcing end of support for AWS Neuron reference for Megatron-LM

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.12 will be the last release that will include support for AWS Neuron reference for Megatron-LM. Future releases will not include Neuron support for Megatron-LM.

Read more ...

AWS Deep Learning AMIs now available with Neuron 2.12 version

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

We are happy to announce that the following Deep Learning AMIs are now available with latest Neuron Version 2.12.

Read more ...

Announcing end of support for Python 3.7

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.12 will be the last release that will include support for Python 3.7 . Future Neuron releases will not include support for Python 3.7

Read more ...

Announcing end of support for Ubuntu 18

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.12 will be the last release that will include support for Ubuntu 18 . Future Neuron releases will not include support for Ubuntu 18

Read more ...

AWS Deep Learning AMIs now available with Neuron 2.10 version

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

We are happy to announce that the following Deep Learning AMIs are now available with latest Neuron Version 2.10. These DLAMIs now support all the Neuron EC2 instances including Inf1, Inf2, Trn1/Trn1n.

Read more ...

Announcing end of support for tensorflow-neuron versions 2.7

This document is relevant for: Inf1, Trn3

Neuron release 2.10 will be the last release that will include tensorflow-neuron versions 2.7. Future Neuron releases will not include tensorflow-neuron versions 2.7

Read more ...

Announcing end of support for mxnet-neuron versions 1.5

This document is relevant for: Inf1, Trn3

Neuron release 2.10 will be the last release that will include mxnet-neuron versions 1.5. Future Neuron releases will not include mxnet-neuron versions 1.5

Read more ...

PyTorch 1.13 Deep Learning Container for Inf2 & Trn1/Trn1n now available for SageMaker

This document is relevant for: Inf2, Trn1, Trn2, Trn3

We are happy to announce that an updated Deep Learning Container that supports PyTorch 1.13 and Neuron 2.9.1 versions is now available for Sagemaker Training.

Read more ...

Introducing Neuron packaging and installation changes for Inf1 customers

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.5, Neuron introduces changes in Neuron packages and installation instructions for Inf1, the following Neuron packages will change names:

Read more ...

Announcing end of support for tensorflow-neuron versions 2.5 and 2.6

This document is relevant for: Inf1, Trn3

Neuron release 2.5 will be the last release that will include tensorflow-neuron versions 2.5 and 2.6. Future Neuron releases will not include tensorflow-neuron versions 2.5 and 2.6.

Read more ...

Announcing end of support for torch-neuron versions 1.7 and 1.8

This document is relevant for: Inf1, Trn3

Neuron release 2.5 will be the last release that will include torch-neuron versions 1.7 and 1.8. Future Neuron releases will not include torch-neuron versions 1.7 and 1.8.

Read more ...

Neuron GPG key for Ubuntu installation has expired

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

GPG, or GNU Privacy Guard, is a public key cryptography implementation. This allows for the secure transmission of information between parties and can be used to verify that the origin of a message is genuine.

Read more ...

Amazon SageMaker now supports Trn1 training jobs

This document is relevant for: Inf2, Trn1, Trn2, Trn3

We are happy to announce that Amazon SageMaker now supports running training jobs on ml.trn1 instance types.

Read more ...

Introducing AWS Deep Learning AMI Neuron PyTorch

This document is relevant for: Inf2, Trn1, Trn2, Trn3

We are happy to announce that Deep Learning AMI (DLAMI) with pre-installed PyTorch Neuron (torch-neuronx) is now available, for more information see:

Read more ...

Introducing the first release of Neuron 2.x enabling EC2 Trn1 General Availability (GA)

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Neuron release 2.3 is the first release of Neuron 2.x that enables GA of the new EC2 Trn1 instances. Neuron release 2.3 extends the latest release of Neuron 1.x (Neuron 1.19.2), adding support for Deep Learning training on the AWS Trainium chips.

Read more ...

Introducing Packaging and installation changes

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.3, Neuron introduces changes in Neuron packages and installation instructions.

Read more ...

Introducing New Neuron GitHub Repositories

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.3, Neuron Github repositories will be migrated to the new AWS Neuron GitHub Organization.

Read more ...

Announcing Neuron Runtime 1.x (neuron-rtd) end-of-support

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Starting with Neuron release 2.3, Neuron components like Neuron System Tools and Neuron Driver will no longer support Neuron Runtime 1.x.

Read more ...

End of support for torch-neuron version 1.5

This document is relevant for: Inf1, Trn3

Starting with Neuron 1.19.0 release, torch-neuron 1.5 will no longer be supported, and no further releases of torch-neuron version 1.5 will be issued. Current users of torch-neuron version 1.5 are advised to migrate to latest torch-neuron version.

Read more ...

End of support for tensorflow-neuron versions 2.1, 2.2, 2.3 and 2.4

This document is relevant for: Inf1, Trn3

Starting with Neuron 1.18.0 release, tensorflow-neuron versions 2.1, 2.2, 2.3 and 2.4 will no longer be supported, and no further releases of tensorflow-neuron versions 2.1, 2.2, 2.3 and 2.4 will be issued. Current users of those versions are advised to migrate to latest tensorflow-neuron version.

Read more ...

Announcing end of support for torch-neuron version 1.5 starting with Neuron 1.19.0 release

This document is relevant for: Inf1, Trn3

Starting with Neuron 1.19.0 release, torch-neuron version 1.5 will no longer be supported. Last release of torch-neuron version 1.5 will be issued as part of Neuron 1.18.0 release. Current users of those versions are advised to migrate to latest torch-neuron version.

Read more ...

Announcing end of support for NEURONCORE_GROUP_SIZES starting with Neuron 1.20.0 release

This document is relevant for: Inf1, Trn3

Starting with Neuron SDK 1.20.0, NEURONCORE_GROUP_SIZES environment variable will no longer be supported. Setting NEURONCORE_GROUP_SIZES environment variable will no longer affect applications behavior. Current customers using NEURONCORE_GROUP_SIZES environment variable are advised to use NEURON_RT_VISIBLE_CORES environment variable or NEURON_RT_NUM_CORES environment variable instead.

Read more ...

Previous Announcements

This document is relevant for: Inf1, Trn3

02/17/2022 - tensorflow-neuron versions 2.1, 2.2, 2.3 and 2.4 enter maintenance mode

Read more ...