This document is relevant for: Inf2, Trn1
Install TensorFlow 2.x (tensorflow-neuronx)#
Warning
This document is archived. TensorFlow is no longer officially supported by the AWS Neuron SDK. It is provided for reference only. For current framework support, see ML framework support on AWS Neuron SDK.
Note
For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.
When launching a Trn1, please adjust your primary EBS volume size to a minimum of 512GB.
# Install Python
sudo dnf install python3.12
# Install Python venv
sudo dnf install -y python3.12-venv gcc-c++
# Create Python venv
python3.12 -m venv aws_neuron_venv_tensorflow_2_10
# Activate Python venv
source aws_neuron_venv_tensorflow_2_10/bin/activate
python -m pip install -U pip
# Install Jupyter notebook kernel
pip install ipykernel
python3.12 -m ipykernel install --user --name aws_neuron_venv_tensorflow_2_10 --display-name "Python (tensorflow-neuronx)"
pip install jupyter notebook
pip install environment_kernels
# Set pip repository pointing to the Neuron repository
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Install wget, awscli
python -m pip install wget
python -m pip install awscli
# Install Neuron Compiler and Framework
python -m pip install neuronx-cc==2.25.3371.0 tensorflow-neuronx==2.10.1.2.1.0
Note
For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.
When launching a Trn1, please adjust your primary EBS volume size to a minimum of 512GB.
# Install Python
sudo add-apt-repository ppa:deadsnakes/ppa
sudo apt-get install python3.12
# Install Python venv
sudo apt-get install -y python3.12-venv g++
# Create Python venv
python3.12 -m venv aws_neuron_venv_tensorflow_2_10
# Activate Python venv
source aws_neuron_venv_tensorflow_2_10/bin/activate
python -m pip install -U pip
# Install Jupyter notebook kernel
pip install ipykernel
python3.12 -m ipykernel install --user --name aws_neuron_venv_tensorflow_2_10 --display-name "Python (tensorflow-neuronx)"
pip install jupyter notebook
pip install environment_kernels
# Set pip repository pointing to the Neuron repository
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Install wget, awscli
python -m pip install wget
python -m pip install awscli
# Install Neuron Compiler and Framework
python -m pip install neuronx-cc==2.25.3371.0 tensorflow-neuronx==2.10.1.2.1.0
Note
For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.
When launching a Trn1, please adjust your primary EBS volume size to a minimum of 512GB.
# Install Python
sudo dnf install python3.12
# Install Python venv
sudo dnf install -y python3.12-venv gcc-c++
# Create Python venv
python3.12 -m venv aws_neuron_venv_tensorflow_2_10
# Activate Python venv
source aws_neuron_venv_tensorflow_2_10/bin/activate
python -m pip install -U pip
# Install Jupyter notebook kernel
pip install ipykernel
python3.12 -m ipykernel install --user --name aws_neuron_venv_tensorflow_2_10 --display-name "Python (tensorflow-neuronx)"
pip install jupyter notebook
pip install environment_kernels
# Set pip repository pointing to the Neuron repository
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Install wget, awscli
python -m pip install wget
python -m pip install awscli
# Install Neuron Compiler and Framework
python -m pip install neuronx-cc==2.25.3371.0 tensorflow-neuronx==2.10.1.2.1.0
Note
For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.
When launching a Trn1, please adjust your primary EBS volume size to a minimum of 512GB.
# Install Python
sudo add-apt-repository ppa:deadsnakes/ppa
sudo apt-get install python3.12
# Install Python venv
sudo apt-get install -y python3.12-venv g++
# Create Python venv
python3.12 -m venv aws_neuron_venv_tensorflow_2_10
# Activate Python venv
source aws_neuron_venv_tensorflow_2_10/bin/activate
python -m pip install -U pip
# Install Jupyter notebook kernel
pip install ipykernel
python3.12 -m ipykernel install --user --name aws_neuron_venv_tensorflow_2_10 --display-name "Python (tensorflow-neuronx)"
pip install jupyter notebook
pip install environment_kernels
# Set pip repository pointing to the Neuron repository
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Install wget, awscli
python -m pip install wget
python -m pip install awscli
# Install Neuron Compiler and Framework
python -m pip install neuronx-cc==2.25.3371.0 tensorflow-neuronx==2.10.1.2.1.0
Note
For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.
When launching a Trn1, please adjust your primary EBS volume size to a minimum of 512GB.
# Install Python
sudo dnf install python3.12
# Install Python venv
sudo dnf install -y python3.12-venv gcc-c++
# Create Python venv
python3.12 -m venv aws_neuron_venv_tensorflow_2_8
# Activate Python venv
source aws_neuron_venv_tensorflow_2_8/bin/activate
python -m pip install -U pip
# Install Jupyter notebook kernel
pip install ipykernel
python3.12 -m ipykernel install --user --name aws_neuron_venv_tensorflow_2_8 --display-name "Python (tensorflow-neuronx)"
pip install jupyter notebook
pip install environment_kernels
# Set pip repository pointing to the Neuron repository
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Install wget, awscli
python -m pip install wget
python -m pip install awscli
# Install Neuron Compiler and Framework
python -m pip install neuronx-cc==2.25.3371.0 tensorflow-neuronx==2.8.4.2.1.0
Note
For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.
When launching a Trn1, please adjust your primary EBS volume size to a minimum of 512GB.
# Install Python
sudo add-apt-repository ppa:deadsnakes/ppa
sudo apt-get install python3.12
# Install Python venv
sudo apt-get install -y python3.12-venv g++
# Create Python venv
python3.12 -m venv aws_neuron_venv_tensorflow_2_8
# Activate Python venv
source aws_neuron_venv_tensorflow_2_8/bin/activate
python -m pip install -U pip
# Install Jupyter notebook kernel
pip install ipykernel
python3.12 -m ipykernel install --user --name aws_neuron_venv_tensorflow_2_8 --display-name "Python (tensorflow-neuronx)"
pip install jupyter notebook
pip install environment_kernels
# Set pip repository pointing to the Neuron repository
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Install wget, awscli
python -m pip install wget
python -m pip install awscli
# Install Neuron Compiler and Framework
python -m pip install neuronx-cc==2.25.3371.0 tensorflow-neuronx==2.8.4.2.1.0
Note
For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.
When launching a Trn1, please adjust your primary EBS volume size to a minimum of 512GB.
# Install Python venv
sudo dnf install -y python3.8-venv gcc-c++
# Create Python venv
python3.8 -m venv aws_neuron_venv_tensorflow_2_7
# Activate Python venv
source aws_neuron_venv_tensorflow_2_7/bin/activate
python -m pip install -U pip
# Install Jupyter notebook kernel
pip install ipykernel
python3.8 -m ipykernel install --user --name aws_neuron_venv_tensorflow_2_7 --display-name "Python (tensorflow-neuronx)"
pip install jupyter notebook
pip install environment_kernels
# Set pip repository pointing to the Neuron repository
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Install wget, awscli
python -m pip install wget
python -m pip install awscli
# Install Neuron Compiler and Framework
python -m pip install neuronx-cc==2.13.72.0 tensorflow-neuronx==2.7.4.2.1.0
Note
For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.
When launching a Trn1, please adjust your primary EBS volume size to a minimum of 512GB.
# Install Python venv
sudo apt-get install -y python3.8-venv g++
# Create Python venv
python3.8 -m venv aws_neuron_venv_tensorflow_2_7
# Activate Python venv
source aws_neuron_venv_tensorflow_2_7/bin/activate
python -m pip install -U pip
# Install Jupyter notebook kernel
pip install ipykernel
python3.8 -m ipykernel install --user --name aws_neuron_venv_tensorflow_2_7 --display-name "Python (tensorflow-neuronx)"
pip install jupyter notebook
pip install environment_kernels
# Set pip repository pointing to the Neuron repository
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
# Install wget, awscli
python -m pip install wget
python -m pip install awscli
# Install Neuron Compiler and Framework
python -m pip install neuronx-cc==2.13.72.0 tensorflow-neuronx==2.7.4.2.1.0
This document is relevant for: Inf2, Trn1