<no title> — AWS Neuron Documentation

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Install TensorFlow Neuron (tensorflow-neuron)

# Install Python 
sudo add-apt-repository ppa:deadsnakes/ppa
sudo apt-get install python3.9

# Install Python venv 
sudo apt-get install -y python3.9-venv g++ 

# Create Python venv
python3.9 -m venv aws_neuron_venv_tensorflow_inf1 

# Activate Python venv 
source aws_neuron_venv_tensorflow_inf1/bin/activate 
python -m pip install -U pip 

# Install Jupyter notebook kernel
pip install ipykernel 
python3.9 -m ipykernel install --user --name aws_neuron_venv_tensorflow_inf1 --display-name "Python (tensorflow-neuron)"
pip install jupyter notebook
pip install environment_kernels

# Set pip repository pointing to the Neuron repository 
python -m pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com

# Install TensorFlow Neuron
python -m pip install tensorflow-neuron[cc] "protobuf"

# Install Neuron TensorBoard
python -m pip install tensorboard-plugin-neuron

# Optional: Install Tensorflow Neuron model server
sudo apt-get install tensorflow-model-server-neuronx=2.10.1.2.12.2.0 -y

Visit TensorFlow Neuron section for more

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Contents