This document is relevant for: Inf1

Note

Please make sure to upgrade from python 3.7 to python 3.8 to use Neuron SDK on Amazon Linux 2. Starting from Neuron Release 2.13, python 3.7 is no longer supported as mentioned here. Also, we do not have support for torch-neuronx 2.1.2 on Amaznon Linux 2.

Select a Different Framework or Platform for Setup

MXNet Neuron (“mxnet-neuron”) Setup on Amazon Linux 2#

Note

Please make sure to upgrade from python 3.7 to python 3.8 to use Neuron SDK on Amazon Linux 2. Starting from Neuron Release 2.13, python 3.7 is no longer supported as mentioned here. Also, we do not have support for torch-neuronx 2.1.2 on Amaznon Linux 2.

Get Started with Latest Release of MXNet Neuron (mxnet-neuron)#

This section provide links that will assist you to quickly start with a fresh installation of Install MXNet Neuron.

Launch the Instance

  • Please follow the instructions at launch an Amazon EC2 Instance to launch an instance. When choosing the instance type at the EC2 console, please make sure to select the correct instance type.

  • To get more information about instances sizes and pricing see: Inf1 web page

  • Select Amazon Linux 2 AMI(HVM) - Kernel 5.10

  • After launching the instance, follow the instructions in Connect to your instance to connect to the instance

Install Drivers and Tools

Note

Inf1 instances are no longer supported. The installation and upgrade commands that were previously generated on this page have been removed. This document is retained for archival reference only.

Install MXNet Neuron (mxnet-neuron)
# Install Python 
sudo dnf install python3.9

# Install Python venv 
sudo dnf install -y python3.9-venv gcc-c++ 

# Create Python venv
python3.9 -m venv aws_neuron_venv_mxnet_inf1 

# Activate Python venv 
source aws_neuron_venv_mxnet_inf1/bin/activate 
python -m pip install -U pip 

# Install Jupyter notebook kernel
pip install ipykernel 
python3.9 -m ipykernel install --user --name aws_neuron_venv_mxnet_inf1 --display-name "Python (mx_neuron)"
pip install jupyter notebook
pip install environment_kernels

# Set pip repository pointing to the Neuron repository 
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com

# Install MXNet Neuron
wget https://aws-mx-pypi.s3.us-west-2.amazonaws.com/1.8.0/aws_mx-1.8.0.2-py2.py3-none-manylinux2014_x86_64.whl
pip install aws_mx-1.8.0.2-py2.py3-none-manylinux2014_x86_64.whl
python -m pip install mx_neuron==1.8.0.2.4.147.0 neuron-cc
Visit MXNet Neuron(mxnet-neuron) for Inference section

Update to latest MXNet Neuron (mxnet-neuron)#

Warning

This document is archived. MXNet is no longer officially supported by the AWS Neuron SDK. It is provided for reference only. For current framework support, see ML framework support on AWS Neuron SDK.

If you already have a previous Neuron release installed, this section provide links that will assist you to update to latest Neuron release.

Note

For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.

Note

Inf1 instances are no longer supported. The installation and upgrade commands that were previously generated on this page have been removed. This document is retained for archival reference only.

Note

For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.

Note

Inf1 instances are no longer supported. The installation and upgrade commands that were previously generated on this page have been removed. This document is retained for archival reference only.

Install Previous MXNet Neuron Releases for Amazon Linux (mxnet-neuron)#

Warning

This document is archived. MXNet is no longer officially supported by the AWS Neuron SDK. It is provided for reference only. For current framework support, see ML framework support on AWS Neuron SDK.

This section will assist you in installing previous Neuron releases.

Note

Inf1 instances are no longer supported. The installation and upgrade commands that were previously generated on this page have been removed. This document is retained for archival reference only.

Note

Inf1 instances are no longer supported. The installation and upgrade commands that were previously generated on this page have been removed. This document is retained for archival reference only.

Note

Inf1 instances are no longer supported. The installation and upgrade commands that were previously generated on this page have been removed. This document is retained for archival reference only.

This document is relevant for: Inf1