This document is relevant for: Inf1

Inference on Inf1 (tensorflow-neuron)

Setup (tensorflow-neuron)

Tutorials (tensorflow-neuron)

Natural Language Processing (NLP) Tutorials

• Tensorflow 2.x - HuggingFace Pipelines distilBERT with Tensorflow2 Neuron [html] [notebook]

Utilizing Neuron Capabilities Tutorials

• Tensorflow 2.x - Using NEURON_RT_VISIBLE_CORES with TensorFlow Serving [html]

Note

To use Jupyter Notebook see:

• Jupyter Notebook QuickStart

• Running Jupyter Notebook as script

Additional Examples (tensorflow-neuron)

• AWS Neuron Samples GitHub Repository

API Reference Guide (tensorflow-neuron)

• TensorFlow 2.x (tensorflow-neuron) Tracing API

• TensorFlow 2.x (tensorflow-neuron) analyze_model API

• TensorFlow 2.x (tensorflow-neuron) Auto Multicore Replication (Beta)

Misc (tensorflow-neuron)

• TensorFlow 2.x (tensorflow-neuron) Release Notes

• TensorFlow 2.x (tensorflow-neuron) Accelerated (torch-neuron) Python APIs and Graph Ops

This document is relevant for: Inf1