PyTorch Quick Start

Note

  • Instructions in this page only apply to setting up Neuron components on Linux host running Ubuntu or Amazon Linux AMI.

  • For an example of how to install Neuron components in a container, see Docker environment setup and our Containers documentation for more details.

  1. Launch an Inf1.6xlarge Instance:
    • Please follow the instructions at launch an Amazon EC2 Instance to Launch an Inf1 instance, when choosing the instance type at the EC2 console. Please make sure to select the correct instance type. To get more information about Inf1 instances sizes and pricing see Inf1 web page.

    • When choosing an Amazon Machine Image (AMI) make sure to select Deep Learning AMI with Conda Options. Please note that Neuron Conda environments are supported only in Ubuntu 18 DLAMI and Amazon Linux2 DLAMI, Neuron Conda environments are not supported in Amazon Linux DLAMI.

    • After launching the instance, follow the instructions in Connect to your instance to connect to the instance

    Note

    You can also launch the instance from AWS CLI, please see AWS CLI commands to launch inf1 instances.

  2. Set up a development environment:

    Important

    For successful installation or update to Neuron 1.16.0 and newer from previous releases:
    • Stop Neuron Runtime 1.x daemon (neuron-rtd) by running: sudo systemctl stop neuron-rtd

    • Uninstall neuron-rtd by running: sudo apt remove aws-neuron-runtime or sudo yum remove aws-neuron-runtime

    • Install or upgrade to latest Neuron driver (aws-neuron-dkms) by following the “Setup Guide” instructions.

    • Visit Introducing Neuron Runtime 2.x (libnrt.so) for more information.

    • Enable or install PyTorch-Neuron:

      Note

      For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.

      # Note: There is no DLAMI Conda environment for this framework version
      #       Framework will be installed/updated inside a Python environment
      
      # Update OS packages
      sudo apt-get update -y
      
      ###############################################################################################################
      # Before installing or updating aws-neuron-dkms:
      # - Stop any existing Neuron runtime 1.0 daemon (neuron-rtd) by calling: 'sudo systemctl stop neuron-rtd'
      ###############################################################################################################
      
      ################################################################################################################
      # To install or update to Neuron versions 1.16.0 and newer from previous releases:
      # - DO NOT skip 'aws-neuron-dkms' install or upgrade step, you MUST install or upgrade to latest Neuron driver
      ################################################################################################################
      
      # Install OS headers
      sudo apt-get install linux-headers-$(uname -r) -y
      
      # Install Neuron Driver
      sudo apt-get install aws-neuron-dkms -y
      
      ####################################################################################
      # Warning: If Linux kernel is updated as a result of OS package update
      #          Neuron driver (aws-neuron-dkms) should be re-installed after reboot
      ####################################################################################
      
      # Install Neuron Tools
      sudo apt-get install aws-neuron-tools -y
      
      export PATH=/opt/aws/neuron/bin:$PATH
      
      # Activate PyTorch
      source activate aws_neuron_pytorch_p36
      
      # Set Pip repository  to point to the Neuron repository
      pip config set global.extra-index-url https://pip.repos.neuron.amazonaws.com
      
      #Install Neuron PyTorch
      pip install torch-neuron neuron-cc[tensorflow] torchvision