TensorFlow on Inf1 (legacy)#

Warning

Legacy hardware: Inf1 instances use NeuronCore v1 with TensorFlow 2.x (tensorflow-neuron).

For new projects, use Inf2, Trn1, Trn2, or Trn3 with PyTorch 2.9+ or JAX 0.7+. See Install AWS Neuron SDK for current setup options.

Note

TensorFlow support for Inf2 has reached end of support as of Neuron SDK 2.29. See Announcing end of support for TensorFlow for Inferentia2 (Inf2) starting with Neuron 2.29 for details.

Setup instructions#

For complete Inf1 TensorFlow setup instructions, see the original setup guides:

The setup guides cover:

  • Ubuntu 20, Ubuntu 22, and Amazon Linux 2 installation

  • DLAMI-based installation

  • Manual pip installation

  • TensorFlow 2.10.1, 2.9.3, and 2.8.4 versions

Verification#

After installation, verify with:

import tensorflow as tf
import tensorflow_neuron

print(f"TensorFlow version: {tf.__version__}")

neuron-ls

Next steps#