This document is relevant for: Inf1, Inf2, Trn1, Trn1n

Neuron Runtime no longer supports Amazon Linux 2 (AL2)#

Starting from Neuron release 2.20, the Neuron Runtime (aws-neuronx-runtime-lib) will no longer support Amazon Linux 2 (AL2). The Neuron Driver (aws-neuronx-dkms) is now the only Neuron package that supports Amazon Linux 2.

This change introduces the following constraint:

Customers cannot run their full Neuron-powered applications natively on an AL2-based Amazon Machine Image (AMI). To leverage Neuron functionality on an AL2 AMI, customers must containerize their applications using a Neuron supported container with non-AL2 Linux distribution (e.g., Ubuntu 22.04, Amazon Linux 2023, etc.) and then deploy those containers on an AL2-based AMI that has the Neuron Driver (aws-neuronx-dkms) installed.

How does this impact me?#

I have an AL2 DLAMI

If you are using one of the following Amazon Linux 2 DLAMIs, please migrate to a supported DLAMI (e.g., Ubuntu 22.04, Amazon Linux 2023 (AL2023), etc.). Please see Neuron DLAMI User Guide for a list of all supported DLAMIs to migrate to.

Framework

Operating System

DLAMI Name

PyTorch 1.13

Amazon Linux 2

Deep Learning AMI Neuron PyTorch 1.13 (Amazon Linux 2)

TensorFlow 2.10

Amazon Linux 2

Deep Learning AMI Neuron TensorFlow 2.10 (Amazon Linux 2)

I am using my own AL2 Container

If you using your own AL2 Container, please migrate to a Neuron supported container with non-AL2 Linux distribution (e.g., Ubuntu 22.04, Amazon Linux 2023, etc.)

I am using a base AL2 DLAMI

If you are using a base Amazon Linux 2 DLAMI, please ensure the Neuron Driver (aws-neuronx-dkms) is the only Neuron package installed. Please use non AL2 (e.g., Ubuntu 22.04, Amazon Linux 2023, etc.) containers to run your Neuron applications.

Note

Neuron does not supports Linux kernel versions < 5.10. Customers using Linux kernel versions < 5.10 must migrate to >= 5.10. To see Linux kernel versions supported by the Neuron Driver, see Release Artifacts.

This document is relevant for: Inf1, Inf2, Trn1, Trn1n