This document is relevant for: Inf1
MXNet Neuron (“mxnet-neuron”) Setup on Amazon Linux 2#
Note
Please make sure to upgrade from python 3.7 to python 3.8 to use Neuron SDK on Amazon Linux 2. Starting from Neuron Release 2.13, python 3.7 is no longer supported as mentioned here.
Also, we do not have support for torch-neuronx 2.1.2 on Amaznon Linux 2.
Get Started with Latest Release of MXNet Neuron (mxnet-neuron)#
This section provide links that will assist you to quickly start with a fresh installation of Install MXNet Neuron.
Launch the Instance
Please follow the instructions at launch an Amazon EC2 Instance to launch an instance. When choosing the instance type at the EC2 console. please make sure to select the correct instance type.
To get more information about instance sizes and pricing see: Inf1 web page
Check for the latest version of the DLAMI Base AMI and copy the AMI name that starts with “Deep Learning Base Neuron AMI (Amazon Linux 2) <latest_date>” from “AMI Name:” section
Search for the copied AMI name in the AMI Search , you should see a matching AMI with the AMI name in Community AMIs. Select the AMI and use it to launch the instance.
After launching the instance, follow the instructions in Connect to your instance to connect to the instance
Install Drivers and Tools
Traceback (most recent call last):
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 1151, in <module>
print(n2_manifest.generate_script(args))
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 121, in generate_script
str_driver = self.install_neuron_driver(args)
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 373, in install_neuron_driver
driver_package = self.get_package_names(category='driver', instance=args.instance)[0]
IndexError: list index out of range
Install MXNet Neuron (mxnet-neuron)
Traceback (most recent call last):
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 1151, in <module>
print(n2_manifest.generate_script(args))
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 121, in generate_script
str_driver = self.install_neuron_driver(args)
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 373, in install_neuron_driver
driver_package = self.get_package_names(category='driver', instance=args.instance)[0]
IndexError: list index out of range
Update to latest MXNet Neuron (mxnet-neuron)#
Warning
This document is archived. MXNet is no longer officially supported by the AWS Neuron SDK. It is provided for reference only. For current framework support, see ML framework support on AWS Neuron SDK.
If you already have a previous Neuron release installed, this section provide links that will assist you to update to latest Neuron release.
Note
For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.
Traceback (most recent call last):
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 1151, in <module>
print(n2_manifest.generate_script(args))
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 121, in generate_script
str_driver = self.install_neuron_driver(args)
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 373, in install_neuron_driver
driver_package = self.get_package_names(category='driver', instance=args.instance)[0]
IndexError: list index out of range
Note
For a successful installation or update, execute each line of the instructions below separately or copy the contents of the code block into a script file and source its contents.
Traceback (most recent call last):
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 1151, in <module>
print(n2_manifest.generate_script(args))
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 121, in generate_script
str_driver = self.install_neuron_driver(args)
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 373, in install_neuron_driver
driver_package = self.get_package_names(category='driver', instance=args.instance)[0]
IndexError: list index out of range
Install Previous MXNet Neuron Releases for Amazon Linux (mxnet-neuron)#
Warning
This document is archived. MXNet is no longer officially supported by the AWS Neuron SDK. It is provided for reference only. For current framework support, see ML framework support on AWS Neuron SDK.
This section will assist you in installing previous Neuron releases.
Traceback (most recent call last):
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 1151, in <module>
print(n2_manifest.generate_script(args))
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 121, in generate_script
str_driver = self.install_neuron_driver(args)
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 373, in install_neuron_driver
driver_package = self.get_package_names(category='driver', instance=args.instance)[0]
IndexError: list index out of range
Traceback (most recent call last):
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 1151, in <module>
print(n2_manifest.generate_script(args))
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 121, in generate_script
str_driver = self.install_neuron_driver(args)
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 373, in install_neuron_driver
driver_package = self.get_package_names(category='driver', instance=args.instance)[0]
IndexError: list index out of range
Traceback (most recent call last):
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 1151, in <module>
print(n2_manifest.generate_script(args))
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 121, in generate_script
str_driver = self.install_neuron_driver(args)
File "/home/docs/checkouts/readthedocs.org/user_builds/awsdocs-neuron/checkouts/latest/src/helperscripts/n2-helper.py", line 373, in install_neuron_driver
driver_package = self.get_package_names(category='driver', instance=args.instance)[0]
IndexError: list index out of range
This document is relevant for: Inf1