.. _install-neuron-tensorflow: Install TensorFlow Neuron ========================= .. include:: /setup/install-templates/inf1/note-setup-cntr.rst .. contents:: Table of contents :local: :depth: 2 Develop on AWS ML accelerator instance ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ .. include:: /setup/install-templates/inf1/develop_mode.rst .. include :: /setup/install-templates/inf1/note-setup-libnrt-warning.rst .. tab-set:: .. tab-item:: TensorFlow 2.10.1 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --category=compiler_framework --framework=tensorflow --framework-version=2.10.1 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --category=compiler_framework --framework=tensorflow --framework-version=2.10.1 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami .. tab-item:: TensorFlow 2.9.3 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --category=compiler_framework --framework=tensorflow --framework-version=2.9.3 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --category=compiler_framework --framework=tensorflow --framework-version=2.9.3 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami .. tab-item:: TensorFlow 2.8.4 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --category=compiler_framework --framework=tensorflow --framework-version=2.8.4 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --category=compiler_framework --framework=tensorflow --framework-version=2.8.4 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami .. tab-item:: TensorFlow 2.7.4 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --category=compiler_framework --framework=tensorflow --framework-version=2.7.4 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --category=compiler_framework --framework=tensorflow --framework-version=2.7.4 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami .. tab-item:: TensorFlow 1.15.5 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --category=compiler_framework --framework=tensorflow --framework-version=1.15.5 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --category=compiler_framework --framework=tensorflow --framework-version=1.15.5 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami Compile on compute instance ^^^^^^^^^^^^^^^^^^^^^^^^^^^ .. include:: /setup/install-templates/inf1/compile_mode.rst .. tab-set:: .. tab-item:: TensorFlow 2.10.1 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=compile --category=compiler_framework --framework=tensorflow --framework-version=2.10.1 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=compile --category=compiler_framework --framework=tensorflow --framework-version=2.10.1 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami .. tab-item:: TensorFlow 2.9.3 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=compile --category=compiler_framework --framework=tensorflow --framework-version=2.9.3 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=compile --category=compiler_framework --framework=tensorflow --framework-version=2.9.3 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami .. tab-item:: TensorFlow 2.8.4 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=compile --category=compiler_framework --framework=tensorflow --framework-version=2.8.4 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=compile --category=compiler_framework --framework=tensorflow --framework-version=2.8.4 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami .. tab-item:: TensorFlow 2.7.4 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=compile --category=compiler_framework --framework=tensorflow --framework-version=2.7.4 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=compile --category=compiler_framework --framework=tensorflow --framework-version=2.7.4 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami .. tab-item:: TensorFlow 1.15.5 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=compile --category=compiler_framework --framework=tensorflow --framework-version=1.15.5 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=compile --category=compiler_framework --framework=tensorflow --framework-version=1.15.5 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami Deploy on AWS ML accelerator instance ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ .. include:: /setup/install-templates/inf1/deploy_mode.rst .. include :: /setup/install-templates/inf1/note-setup-libnrt-warning.rst .. tab-set:: .. tab-item:: TensorFlow 2.10.1 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=deploy --category=compiler_framework --framework=tensorflow --framework-version=2.10.1 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=deploy --category=compiler_framework --framework=tensorflow --framework-version=2.10.1 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami .. tab-item:: TensorFlow 2.9.3 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=deploy --category=compiler_framework --framework=tensorflow --framework-version=2.9.3 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=deploy --category=compiler_framework --framework=tensorflow --framework-version=2.9.3 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami .. tab-item:: TensorFlow 2.8.4 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=deploy --category=compiler_framework --framework=tensorflow --framework-version=2.8.4 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=deploy --category=compiler_framework --framework=tensorflow --framework-version=2.8.4 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami .. tab-item:: TensorFlow 2.7.4 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=deploy --category=compiler_framework --framework=tensorflow --framework-version=2.7.4 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=deploy --category=compiler_framework --framework=tensorflow --framework-version=2.7.4 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami .. tab-item:: TensorFlow 1.15.5 .. tab-set:: .. tab-item:: Ubuntu 20 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=deploy --category=compiler_framework --framework=tensorflow --framework-version=1.15.5 --file=src/helperscripts/n2-manifest.json --os=ubuntu20 --instance=inf1 --ami=non-dlami .. tab-item:: Amazon Linux 2 DLAMI Base .. include :: /setup/install-templates/inf1/note-setup-general.rst .. program-output:: python3 src/helperscripts/n2-helper.py --install-type=install --mode=deploy --category=compiler_framework --framework=tensorflow --framework-version=1.15.5 --file=src/helperscripts/n2-manifest.json --os=amazonlinux2 --instance=inf1 --ami=non-dlami