This document is relevant for: Inf2, Trn1, Trn1n

Inference on Inf2 & Trn1/Trn1n (tensorflow-neuronx)

Setup (tensorflow-neuronx)

Tutorials (tensorflow-neuronx)

• HuggingFace Roberta-Base [html] [notebook]

• Using NEURON_RT_VISIBLE_CORES with TensorFlow Serving

Note

To use Jupyter Notebook see:

• Jupyter Notebook QuickStart

• Running Jupyter Notebook as script

API Reference Guide (tensorflow-neuronx)

• TensorFlow 2.x (tensorflow-neuronx) Tracing API

• TensorFlow Neuron (tensorflow-neuronx) Auto Multicore Replication (Beta)

• TensorFlow 2.x (tensorflow-neuronx) analyze_model API

Misc (tensorflow-neuronx)

• TensorFlow Neuron (tensorflow-neuronx) Release Notes

This document is relevant for: Inf2, Trn1, Trn1n