All Posts

PyTorch NeuronX version 2.0 (Beta) no longer supported

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Neuron release 2.17 no longer supports PyTorch NeuronX version 2.0 (Beta).

Read more ...


Announcing Name Change for Neuron Components

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Starting with Neuron release 2.16, the name of the following Neuron components will change as follows:

Read more ...


Announcing deprecation for NeuronX Distributed Training Samples in Neuron Samples Repository

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Neuron release 2.16 will be the last release to include support for NeuronX Distributed Training Samples (Llama-2, GPT-NeoX 20B, and GPT-NeoX 6.9B) under the AWS Neuron Samples Github repository.

Read more ...


Announcing deprecation for Neuron Containers with Runtime 1.x

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Neuron release 2.3 was the last release to support Neuron Runtime 1.x (neuron-rtd). Current users of Neuron DLC/DLAMI with Neuron Runtime 1.x are required to update their image to support latest Neuron Runtime versions. For instructions, see the Setup Guide.

Read more ...


Announcing End of Support for PyTorch NeuronX version 2.0 (beta)

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Neuron release 2.16 will be the last release that will include beta support for PyTorch NeuronX version 2.0 (beta). Future Neuron releases will not include support for PyTorch NeuronX version 2.0.

Read more ...


Announcing End of Support for PyTorch Neuron version 1.10

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Neuron release 2.16 will be the last release that will include support for PyTorch Neuron version 1.10. Future Neuron releases will not include support for PyTorch Neuron version 1.10.

Read more ...


Announcing End of Support for nemo option-argument

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Neuron release 2.15 will be the last release that will include support for nemo option-argument in the existing –distribution_strategy compiler option. Future releases will not include Neuron support for nemo option-argument. Users are advised to migrate to the new llm-training option-argument.

Read more ...


Announcing End Of Support for OPT example in Transformers NeuronX

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Neuron release 2.15 will be the last release that will include OPT example in Transformers NeuronX.

Read more ...


Announcing deprecation for --model-type=transformer-inference compiler flag

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Title underline too short.

Read more ...


Announcing end of support for torch-neuron version 1.9

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Title underline too short.

Read more ...


AWS Neuron reference for Megatron-LM no longer supported

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Neuron release 2.13 no longer includes support for AWS Neuron reference for Megatron-LM.

Read more ...


Announcing end of support for AWS Neuron reference for Megatron-LM

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Neuron release 2.12 will be the last release that will include support for AWS Neuron reference for Megatron-LM. Future releases will not include Neuron support for Megatron-LM.

Read more ...


AWS Deep Learning AMIs now available with Neuron 2.12 version

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

We are happy to announce that the following Deep Learning AMIs are now available with latest Neuron Version 2.12.

Read more ...


Announcing end of support for Python 3.7

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Title underline too short.

Read more ...


Announcing end of support for Ubuntu 18

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Neuron release 2.12 will be the last release that will include support for Ubuntu 18 . Future Neuron releases will not include support for Ubuntu 18

Read more ...


AWS Deep Learning AMIs now available with Neuron 2.10 version

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

We are happy to announce that the following Deep Learning AMIs are now available with latest Neuron Version 2.10. These DLAMIs now support all the Neuron EC2 instances including Inf1, Inf2, Trn1/Trn1n.

Read more ...


Announcing end of support for tensorflow-neuron versions 2.7

This document is relevant for: Inf1

Neuron release 2.10 will be the last release that will include tensorflow-neuron versions 2.7. Future Neuron releases will not include tensorflow-neuron versions 2.7

Read more ...


Announcing end of support for mxnet-neuron versions 1.5

This document is relevant for: Inf1

Neuron release 2.10 will be the last release that will include mxnet-neuron versions 1.5. Future Neuron releases will not include mxnet-neuron versions 1.5

Read more ...


PyTorch 1.13 Deep Learning Container for Inf2 & Trn1/Trn1n now available for SageMaker

This document is relevant for: Inf2, Trn1, Trn1n

We are happy to announce that an updated Deep Learning Container that supports PyTorch 1.13 and Neuron 2.9.1 versions is now available for Sagemaker Training.

Read more ...


Introducing Neuron packaging and installation changes for Inf1 customers

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Starting with Neuron release 2.5, Neuron introduces changes in Neuron packages and installation instructions for Inf1, the following Neuron packages will change names:

Read more ...


Announcing end of support for tensorflow-neuron versions 2.5 and 2.6

This document is relevant for: Inf1

Neuron release 2.5 will be the last release that will include tensorflow-neuron versions 2.5 and 2.6. Future Neuron releases will not include tensorflow-neuron versions 2.5 and 2.6.

Read more ...


Announcing end of support for torch-neuron versions 1.7 and 1.8

This document is relevant for: Inf1

Neuron release 2.5 will be the last release that will include torch-neuron versions 1.7 and 1.8. Future Neuron releases will not include torch-neuron versions 1.7 and 1.8.

Read more ...


Neuron GPG key for Ubuntu installation has expired

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

GPG, or GNU Privacy Guard, is a public key cryptography implementation. This allows for the secure transmission of information between parties and can be used to verify that the origin of a message is genuine.

Read more ...


Amazon SageMaker now supports Trn1 training jobs

This document is relevant for: Inf2, Trn1, Trn1n

We are happy to announce that Amazon SageMaker now supports running training jobs on ml.trn1 instance types.

Read more ...


Introducing AWS Deep Learning AMI Neuron PyTorch

This document is relevant for: Inf2, Trn1, Trn1n

We are happy to announce that Deep Learning AMI (DLAMI) with pre-installed PyTorch Neuron (torch-neuronx) is now available, for more information see:

Read more ...


Introducing the first release of Neuron 2.x enabling EC2 Trn1 General Availability (GA)

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Neuron release 2.3 is the first release of Neuron 2.x that enables GA of the new EC2 Trn1 instances. Neuron release 2.3 extends the latest release of Neuron 1.x (Neuron 1.19.2), adding support for Deep Learning training on the AWS Trainium chips.

Read more ...


Introducing Packaging and installation changes

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Starting with Neuron release 2.3, Neuron introduces changes in Neuron packages and installation instructions.

Read more ...


Introducing New Neuron GitHub Repositories

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Starting with Neuron release 2.3, Neuron Github repositories will be migrated to the new AWS Neuron GitHub Organization.

Read more ...


Announcing Neuron Runtime 1.x (neuron-rtd) end-of-support

This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Starting with Neuron release 2.3, Neuron components like Neuron System Tools and Neuron Driver will no longer support Neuron Runtime 1.x.

Read more ...


End of support for torch-neuron version 1.5

This document is relevant for: Inf1

Starting with Neuron 1.19.0 release, torch-neuron 1.5 will no longer be supported, and no further releases of torch-neuron version 1.5 will be issued. Current users of torch-neuron version 1.5 are advised to migrate to latest torch-neuron version.

Read more ...


End of support for tensorflow-neuron versions 2.1, 2.2, 2.3 and 2.4

This document is relevant for: Inf1

Starting with Neuron 1.18.0 release, tensorflow-neuron versions 2.1, 2.2, 2.3 and 2.4 will no longer be supported, and no further releases of tensorflow-neuron versions 2.1, 2.2, 2.3 and 2.4 will be issued. Current users of those versions are advised to migrate to latest tensorflow-neuron version.

Read more ...


Announcing end of support for torch-neuron version 1.5 starting with Neuron 1.19.0 release

This document is relevant for: Inf1

Starting with Neuron 1.19.0 release, torch-neuron version 1.5 will no longer be supported. Last release of torch-neuron version 1.5 will be issued as part of Neuron 1.18.0 release. Current users of those versions are advised to migrate to latest torch-neuron version.

Read more ...


Announcing end of support for NEURONCORE_GROUP_SIZES starting with Neuron 1.20.0 release

This document is relevant for: Inf1

Starting with Neuron SDK 1.20.0, NEURONCORE_GROUP_SIZES environment variable will no longer be supported. Setting NEURONCORE_GROUP_SIZES environment variable will no longer affect applications behavior. Current customers using NEURONCORE_GROUP_SIZES environment variable are advised to use NEURON_RT_VISIBLE_CORES environment variable or NEURON_RT_NUM_CORES environment variable instead.

Read more ...


Previous Announcements

This document is relevant for: Inf1

02/17/2022 - tensorflow-neuron versions 2.1, 2.2, 2.3 and 2.4 enter maintenance mode

Read more ...