Get Started with Neuron on Ubuntu 22 with Neuron Multi-Framework DLAMI
Contents
This document is relevant for: Inf1, Inf2, Trn1, Trn1n
Get Started with Neuron on Ubuntu 22 with Neuron Multi-Framework DLAMI#
You can quickly get started on Ubuntu 22 using the Neuron Deep Learning AMI (DLAMI). Then, start using one of the multiple frameworks or libraries that Neuron SDK supports by activating the corresponding virtual environment. Each virtual environment comes pre-installed with Neuron libraries needed for you to get started. The Neuron DLAMI supports all Neuron instances (Inf1/Inf2/Trn1/Trn1n) and is updated with each Neuron SDK release. To start using the latest version of the Neuron DLAMI, use the following steps:
Step 1: Launch the instance using Neuron DLAMI#
Once you open the EC2 Console, select your desired AWS region and choose “Launch Instance”. Under AMI selection select the “Quick Start” and “Ubuntu”, choose the “Deep Learning AMI Neuron (Ubuntu 22.04)”(see screenshot below). Once you have selected the AMI, select the desired Neuron Instance(Inf1/Inf2/Trn1/Trn1n) , configure disk size and other criteria, launch the instance
Note
If you are looking to use the Neuron DLAMI in your cloud automation flows , Neuron also supports SSM parameters to easily retrieve the latest DLAMI id.
Step 2: Activate the desired virtual environment#
You can activate one of the virtual environments below depending on the library or framework you are interested in.
Neuron Framework/Library |
Activate Virtual Environment Instruction |
|---|---|
PyTorch Neuron 2.1 (Torch NeuronX , NeuronX Distributed) |
source /opt/aws_neuronx_venv_pytorch_2_1/bin/activate
|
PyTorch Neuron 1.13.1 (Torch NeuronX , NeuronX Distributed) |
source /opt/aws_neuronx_venv_pytorch_1_13/bin/activate
|
Transformers NeuronX (PyTorch 2.1) |
source /opt/aws_neuronx_venv_transformers_neuronx/bin/activate
|
Tensorflow Neuron 2.10 (Tensorflow NeuronX) |
source /opt/aws_neuronx_venv_tensorflow_2_10/bin/activate
|
PyTorch Neuron 1.13.1 (Inf1) (Torch Neuron) |
source /opt/aws_neuron_venv_pytorch_1_13_inf1/bin/activate
|
Tensorflow 2.10 (Inf1) (Tensorflow Neuron) |
source /opt/aws_neuron_venv_tensorflow_2_10_inf1/bin/activate
|
After you have activated the desired virtual environment , you can try out one of the tutorials listed in the corresponding framework or library training and inference section.
This document is relevant for: Inf1, Inf2, Trn1, Trn1n