Update to latest PyTorch Neuron (torch-neuronx)
This document is relevant for: Trn1
Update to latest PyTorch Neuron (torch-neuronx)#
Note
Instructions in this page only apply to setting up Neuron components on Linux host running Ubuntu or Amazon Linux AMI.
When launching a Trn1, please adjust your primary EBS volume size to a minimum of 512GB.
# Update OS packages
sudo apt-get update -y
# Update OS headers
sudo apt-get install linux-headers-$(uname -r) -y
# Update Neuron Driver and Runtime
sudo apt-get install aws-neuronx-dkms=2.* -y
sudo apt-get install aws-neuronx-oci-hook=2.* -y
sudo apt-get install aws-neuronx-runtime-lib=2.* -y
sudo apt-get install aws-neuronx-collectives=2.* -y
# Update EFA Driver(only required for multiinstance training)
curl -O https://efa-installer.amazonaws.com/aws-efa-installer-latest.tar.gz
wget https://efa-installer.amazonaws.com/aws-efa-installer.key && gpg --import aws-efa-installer.key
cat aws-efa-installer.key | gpg --fingerprint
wget https://efa-installer.amazonaws.com/aws-efa-installer-latest.tar.gz.sig && gpg --verify ./aws-efa-installer-latest.tar.gz.sig
tar -xvf aws-efa-installer-latest.tar.gz
cd aws-efa-installer && sudo bash efa_installer.sh --yes
cd
sudo rm -rf aws-efa-installer-latest.tar.gz aws-efa-installer
# Update Neuron Tools
sudo apt-get install aws-neuronx-tools=2.* -y
# Activate a Python virtual environment where Neuron pip packages were installed.
source aws_neuron_venv_pytorch_p38/bin/activate
# Install packages from repos
python -m pip config set global.extra-index-url "https://pip.repos.neuron.amazonaws.com"
# Update Python packages - Transformers package is needed for BERT
python -m pip install -U torch-neuronx=="1.12.0.1.*" neuronx-cc=="2.*" torchvision
Note
Instructions in this page only apply to setting up Neuron components on Linux host running Ubuntu or Amazon Linux AMI.
When launching a Trn1, please adjust your primary EBS volume size to a minimum of 512GB.
# Update OS headers
sudo yum install kernel-devel-$(uname -r) kernel-headers-$(uname -r) -y
# Update OS packages
sudo yum update -y
# Update Neuron Driver and Runtime
sudo yum install aws-neuronx-dkms-2.* -y
sudo yum install aws-neuronx-oci-hook-2.* -y
sudo yum install aws-neuronx-runtime-lib-2.* -y
sudo yum install aws-neuronx-collectives-2.* -y
# Update EFA Driver(only required for multiinstance training)
curl -O https://efa-installer.amazonaws.com/aws-efa-installer-latest.tar.gz
wget https://efa-installer.amazonaws.com/aws-efa-installer.key && gpg --import aws-efa-installer.key
cat aws-efa-installer.key | gpg --fingerprint
wget https://efa-installer.amazonaws.com/aws-efa-installer-latest.tar.gz.sig && gpg --verify ./aws-efa-installer-latest.tar.gz.sig
tar -xvf aws-efa-installer-latest.tar.gz
cd aws-efa-installer && sudo bash efa_installer.sh --yes
cd
sudo rm -rf aws-efa-installer-latest.tar.gz aws-efa-installer
# Update Neuron Tools
sudo yum install aws-neuronx-tools-2.* -y
# Activate a Python virtual environment where Neuron pip packages were installed.
source aws_neuron_venv_pytorch_p37/bin/activate
# Update packages from repos
python -m pip config set global.extra-index-url "https://pip.repos.neuron.amazonaws.com"
# Update Python packages - Transformers package is needed for BERT
python -m pip install -U torch-neuronx=="1.12.0.1.*" neuronx-cc=="2.*" torchvision
Note
Instructions in this page only apply to setting up Neuron components on Linux host running Ubuntu or Amazon Linux AMI.
When launching a Trn1, please adjust your primary EBS volume size to a minimum of 512GB.
# Update OS packages
sudo apt-get update -y
# Update OS headers
sudo apt-get install linux-headers-$(uname -r) -y
# Update Neuron Driver and Runtime
sudo apt-get install aws-neuronx-dkms=2.* -y
sudo apt-get install aws-neuronx-oci-hook=2.* -y
sudo apt-get install aws-neuronx-runtime-lib=2.* -y
sudo apt-get install aws-neuronx-collectives=2.* -y
# Update EFA Driver(only required for multiinstance training)
curl -O https://efa-installer.amazonaws.com/aws-efa-installer-latest.tar.gz
wget https://efa-installer.amazonaws.com/aws-efa-installer.key && gpg --import aws-efa-installer.key
cat aws-efa-installer.key | gpg --fingerprint
wget https://efa-installer.amazonaws.com/aws-efa-installer-latest.tar.gz.sig && gpg --verify ./aws-efa-installer-latest.tar.gz.sig
tar -xvf aws-efa-installer-latest.tar.gz
cd aws-efa-installer && sudo bash efa_installer.sh --yes
cd
sudo rm -rf aws-efa-installer-latest.tar.gz aws-efa-installer
# Update Neuron Tools
sudo apt-get install aws-neuronx-tools=2.* -y
# Activate a Python virtual environment where Neuron pip packages were installed.
source aws_neuron_venv_pytorch_p38/bin/activate
# Install packages from repos
python -m pip config set global.extra-index-url "https://pip.repos.neuron.amazonaws.com"
# Update Python packages - Transformers package is needed for BERT
python -m pip install -U torch-neuronx=="1.11.0.1.*" neuronx-cc=="2.*" torchvision
Note
Instructions in this page only apply to setting up Neuron components on Linux host running Ubuntu or Amazon Linux AMI.
When launching a Trn1, please adjust your primary EBS volume size to a minimum of 512GB.
# Update OS headers
sudo yum install kernel-devel-$(uname -r) kernel-headers-$(uname -r) -y
# Update OS packages
sudo yum update -y
# Update Neuron Driver and Runtime
sudo yum install aws-neuronx-dkms-2.* -y
sudo yum install aws-neuronx-oci-hook-2.* -y
sudo yum install aws-neuronx-runtime-lib-2.* -y
sudo yum install aws-neuronx-collectives-2.* -y
# Update EFA Driver(only required for multiinstance training)
curl -O https://efa-installer.amazonaws.com/aws-efa-installer-latest.tar.gz
wget https://efa-installer.amazonaws.com/aws-efa-installer.key && gpg --import aws-efa-installer.key
cat aws-efa-installer.key | gpg --fingerprint
wget https://efa-installer.amazonaws.com/aws-efa-installer-latest.tar.gz.sig && gpg --verify ./aws-efa-installer-latest.tar.gz.sig
tar -xvf aws-efa-installer-latest.tar.gz
cd aws-efa-installer && sudo bash efa_installer.sh --yes
cd
sudo rm -rf aws-efa-installer-latest.tar.gz aws-efa-installer
# Update Neuron Tools
sudo yum install aws-neuronx-tools-2.* -y
# Activate a Python virtual environment where Neuron pip packages were installed.
source aws_neuron_venv_pytorch_p37/bin/activate
# Update packages from repos
python -m pip config set global.extra-index-url "https://pip.repos.neuron.amazonaws.com"
# Update Python packages - Transformers package is needed for BERT
python -m pip install -U torch-neuronx=="1.11.0.1.*" neuronx-cc=="2.*" torchvision
This document is relevant for: Trn1