This document is relevant for: Inf2, Trn1

Inference on Inf2 & Trn1/Trn1n (tensorflow-neuronx)

Warning

This document is archived. TensorFlow is no longer officially supported by the AWS Neuron SDK. It is provided for reference only. For current framework support, see ML framework support on AWS Neuron SDK.

Setup (tensorflow-neuronx)

See TensorFlow NeuronX setup.

Tutorials (tensorflow-neuronx)

• HuggingFace Roberta-Base [html] [notebook]

• Using NEURON_RT_VISIBLE_CORES with TensorFlow Serving

Note

To use Jupyter Notebook see:

• Jupyter Notebook QuickStart

• Running Jupyter Notebook as script

API Reference Guide (tensorflow-neuronx)

• TensorFlow 2.x (tensorflow-neuronx) Tracing API

• TensorFlow 2.x (tensorflow-neuronx) Auto Multicore Replication (Beta)

• TensorFlow 2.x (tensorflow-neuronx) analyze_model API

Misc (tensorflow-neuronx)

• TensorFlow 2.x (tensorflow-neuronx) Release Notes

This document is relevant for: Inf2, Trn1