MXNet Neuron (“mxnet-neuron”) Setup on Amazon Linux 2
Contents
This document is relevant for: Inf1
MXNet Neuron (“mxnet-neuron”) Setup on Amazon Linux 2#
Table of contents
Note
Please make sure to upgrade
from python 3.7
to python 3.8
to use Neuron SDK on Amazon Linux 2
. Starting from Neuron Release 2.13
, python 3.7
is no longer supported as mentioned here.
Also, we do not have support for torch-neuronx 2.1.2
on Amaznon Linux 2.
Get Started with Latest Release of MXNet Neuron (mxnet-neuron
)#
This section provide links that will assist you to quickly start with a fresh installation of Install MXNet Neuron.
Launch the Instance
Please follow the instructions at launch an Amazon EC2 Instance to launch an instance. When choosing the instance type at the EC2 console. please make sure to select the correct instance type.
To get more information about instance sizes and pricing see: Inf1 web page
Check for the latest version of the DLAMI Base AMI and copy the AMI name that starts with “Deep Learning Base Neuron AMI (Amazon Linux 2) <latest_date>” from “AMI Name:” section
Search for the copied AMI name in the AMI Search , you should see a matching AMI with the AMI name in Community AMIs. Select the AMI and use it to launch the instance.
After launching the instance, follow the instructions in Connect to your instance to connect to the instance
Install Drivers and Tools
# Configure Linux for Neuron repository updates
sudo tee /etc/yum.repos.d/neuron.repo > /dev/null <<EOF
[neuron]
name=Neuron YUM Repository
baseurl=https://yum.repos.neuron.amazonaws.com
enabled=1
metadata_expire=0
EOF
sudo rpm --import https://yum.repos.neuron.amazonaws.com/GPG-PUB-KEY-AMAZON-AWS-NEURON.PUB
# Update OS packages
sudo yum update -y
# Install OS headers
sudo yum install kernel-devel-$(uname -r) kernel-headers-$(uname -r) -y
# Install git
sudo yum install git -y
# install Neuron Driver
sudo yum install aws-neuronx-dkms-2.* -y
# Install Neuron Tools
sudo yum install aws-neuronx-tools-2.* -y
# Add PATH
export PATH=/opt/aws/neuron/bin:$PATH
Install MXNet Neuron (mxnet-neuron
)
# Install Python venv
sudo yum install -y python3.8-venv gcc-c++
# Create Python venv
python3.8 -m venv aws_neuron_venv_mxnet_inf1
# Activate Python venv
source aws_neuron_venv_mxnet_inf1/bin/activate
python -m pip install -U pip
# Install Jupyter notebook kernel
pip install ipykernel
python3.8 -m ipykernel install --user --name aws_neuron_venv_mxnet_inf1 --display-name "Python (mx_neuron)"
pip install jupyter notebook
pip install environment_kernels
# Set pip repository pointing to the Neuron repository
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Install MXNet Neuron
wget https://aws-mx-pypi.s3.us-west-2.amazonaws.com/1.8.0/aws_mx-1.8.0.2-py2.py3-none-manylinux2014_x86_64.whl
pip install aws_mx-1.8.0.2-py2.py3-none-manylinux2014_x86_64.whl
python -m pip install mx_neuron neuron-cc
Update to latest MXNet Neuron (mxnet-neuron
)#
If you already have a previous Neuron release installed, this section provide links that will assist you to update to latest Neuron release.
Note
For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.
# Activate Python venv
source aws_neuron_venv_mxnet_inf1/bin/activate
# Install Jupyter notebook kernel
pip install ipykernel
python3.8 -m ipykernel install --user --name aws_neuron_venv_mxnet_inf1 --display-name "Python (mx_neuron)"
pip install jupyter notebook
pip install environment_kernels
# Set pip repository pointing to the Neuron repository
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Update MXNet Neuron
wget https://aws-mx-pypi.s3.us-west-2.amazonaws.com/1.8.0/aws_mx-1.8.0.2-py2.py3-none-manylinux2014_x86_64.whl
pip install aws_mx-1.8.0.2-py2.py3-none-manylinux2014_x86_64.whl
python -m pip install --upgrade mx_neuron neuron-cc
Note
For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.
# Activate Python venv
source aws_neuron_venv_mxnet_inf1/bin/activate
# Install Jupyter notebook kernel
pip install ipykernel
python3.8 -m ipykernel install --user --name aws_neuron_venv_mxnet_inf1 --display-name "Python (mx_neuron)"
pip install jupyter notebook
pip install environment_kernels
# Set pip repository pointing to the Neuron repository
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Update MXNet Neuron
wget https://aws-mx-pypi.s3.us-west-2.amazonaws.com/1.8.0/aws_mx-1.8.0.2-py2.py3-none-manylinux2014_x86_64.whl
pip install aws_mx-1.8.0.2-py2.py3-none-manylinux2014_x86_64.whl
python -m pip install --upgrade mxnet_neuron==1.5.1.* neuron-cc==1.15.0
Install Previous MXNet Neuron Releases for Amazon Linux (mxnet-neuron
)#
This section will assist you to install previous Neuron releases.
# Install Python venv
sudo yum install -y python3.8-venv gcc-c++
# Create Python venv
python3.8 -m venv aws_neuron_venv_mxnet_inf1
# Activate Python venv
source aws_neuron_venv_mxnet_inf1/bin/activate
python -m pip install -U pip
# Install Jupyter notebook kernel
pip install ipykernel
python3.8 -m ipykernel install --user --name aws_neuron_venv_mxnet_inf1 --display-name "Python (mx_neuron)"
pip install jupyter notebook
pip install environment_kernels
# Set pip repository pointing to the Neuron repository
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Install MXNet Neuron
wget https://aws-mx-pypi.s3.us-west-2.amazonaws.com/1.8.0/aws_mx-1.8.0.2-py2.py3-none-manylinux2014_x86_64.whl
pip install aws_mx-1.8.0.2-py2.py3-none-manylinux2014_x86_64.whl
python -m pip install mx_neuron==1.8.0.2.4.40.0 neuron-cc
# Install Python venv
sudo yum install -y python3.8-venv gcc-c++
# Create Python venv
python3.8 -m venv aws_neuron_venv_mxnet_inf1
# Activate Python venv
source aws_neuron_venv_mxnet_inf1/bin/activate
python -m pip install -U pip
# Install Jupyter notebook kernel
pip install ipykernel
python3.8 -m ipykernel install --user --name aws_neuron_venv_mxnet_inf1 --display-name "Python (mx_neuron)"
pip install jupyter notebook
pip install environment_kernels
# Set pip repository pointing to the Neuron repository
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Install MXNet Neuron
wget https://aws-mx-pypi.s3.us-west-2.amazonaws.com/1.8.0/aws_mx-1.8.0.2-py2.py3-none-manylinux2014_x86_64.whl
pip install aws_mx-1.8.0.2-py2.py3-none-manylinux2014_x86_64.whl
python -m pip install mx_neuron==1.8.0.2.4.40.0 neuron-cc
# Install Python venv
sudo yum install -y python3.8-venv gcc-c++
# Create Python venv
python3.8 -m venv aws_neuron_venv_mxnet_inf1
# Activate Python venv
source aws_neuron_venv_mxnet_inf1/bin/activate
python -m pip install -U pip
# Install Jupyter notebook kernel
pip install ipykernel
python3.8 -m ipykernel install --user --name aws_neuron_venv_mxnet_inf1 --display-name "Python (mx_neuron)"
pip install jupyter notebook
pip install environment_kernels
# Set pip repository pointing to the Neuron repository
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Install MXNet Neuron
wget https://aws-mx-pypi.s3.us-west-2.amazonaws.com/1.8.0/aws_mx-1.8.0.2-py2.py3-none-manylinux2014_x86_64.whl
pip install aws_mx-1.8.0.2-py2.py3-none-manylinux2014_x86_64.whl
python -m pip install mx_neuron==1.8.0.2.4.25.0 neuron-cc
This document is relevant for: Inf1