TensorFlow Quick Start

Note

  • Instructions in this page only apply to setting up Neuron components on Linux host running Ubuntu or Amazon Linux AMI.

  • For an example of how to install Neuron components in a container, see Docker environment setup and our Containers documentation for more details.

  1. Launch an Inf1.6xlarge Instance:
    • Please follow the instructions at launch an Amazon EC2 Instance to Launch an Inf1 instance, when choosing the instance type at the EC2 console. Please make sure to select the correct instance type. To get more information about Inf1 instances sizes and pricing see Inf1 web page.

    • When choosing an Amazon Machine Image (AMI) make sure to select Deep Learning AMI with Conda Options. Please note that Neuron Conda environments are supported only in Ubuntu 18 DLAMI and Amazon Linux2 DLAMI, Neuron Conda environments are not supported in Amazon Linux DLAMI.

    • After launching the instance, follow the instructions in Connect to your instance to connect to the instance

    Note

    You can also launch the instance from AWS CLI, please see AWS CLI commands to launch inf1 instances.

  2. Set up a development environment:

    Important

    For successful installation or update to Neuron 1.16.0 and newer from previous releases:
    • Stop Neuron Runtime 1.x daemon (neuron-rtd) by running: sudo systemctl stop neuron-rtd

    • Uninstall neuron-rtd by running: sudo apt remove aws-neuron-runtime or sudo yum remove aws-neuron-runtime

    • Install or upgrade to latest Neuron driver (aws-neuron-dkms) by following the “Setup Guide” instructions.

    • Visit Introducing Neuron Runtime 2.x (libnrt.so) for more information.

    • Enable or install TensorFlow-Neuron:

      Note

      For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.

      # Note: There is no DLAMI Conda environment for this framework version
      #       Framework will be installed/updated inside a Python environment
      
      # Update OS packages
      sudo apt-get update -y
      
      ###############################################################################################################
      # Before installing or updating aws-neuron-dkms:
      # - Stop any existing Neuron runtime 1.0 daemon (neuron-rtd) by calling: 'sudo systemctl stop neuron-rtd'
      ###############################################################################################################
      
      ################################################################################################################
      # To install or update to Neuron versions 1.16.0 and newer from previous releases:
      # - DO NOT skip 'aws-neuron-dkms' install or upgrade step, you MUST install or upgrade to latest Neuron driver
      ################################################################################################################
      
      # Install OS headers
      sudo apt-get install linux-headers-$(uname -r) -y
      
      # Install Neuron Driver
      sudo apt-get install aws-neuron-dkms -y
      
      ####################################################################################
      # Warning: If Linux kernel is updated as a result of OS package update
      #          Neuron driver (aws-neuron-dkms) should be re-installed after reboot
      ####################################################################################
      
      # Install Neuron Tools
      sudo apt-get install aws-neuron-tools -y
      
      # Install Neuron TensorBoard
      pip install tensorboard-plugin-neuron
      
      export PATH=/opt/aws/neuron/bin:$PATH
      
      # Install Python venv and activate Python virtual environment to install    
      # Neuron pip packages.
      sudo apt-get install -y python3-venv g++
      python3 -m venv tensorflow_venv
      source tensorflow_venv/bin/activate
      pip install -U pip
      
      
      # Instal Jupyter notebook kernel 
      pip install ipykernel 
      python -m ipykernel install --user --name tensorflow_venv --display-name "Python (Neuron TensorFlow)"
      pip install jupyter notebook
      pip install environment_kernels
      
      
      # Set Pip repository  to point to the Neuron repository
      pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
      
      #Install Neuron TensorFlow
      pip install tensorflow-neuron[cc]
      
      # Optional: Install Neuron TensorFlow model server
      sudo apt-get install tensorflow-model-server-neuron --allow-change-held-packages -y