This document is relevant for: Inf1

Inference on Inf1 (tensorflow-neuron)

Warning

This document is archived. TensorFlow is no longer officially supported by the AWS Neuron SDK. It is provided for reference only. For current framework support, see ML framework support on AWS Neuron SDK.

Setup (tensorflow-neuron)

See TensorFlow Neuron setup.

Tutorials (tensorflow-neuron)

Natural Language Processing (NLP) Tutorials

• Tensorflow 2.x - HuggingFace Pipelines distilBERT with Tensorflow2 Neuron [html] [notebook]

Utilizing Neuron Capabilities Tutorials

• Tensorflow 2.x - Using NEURON_RT_VISIBLE_CORES with TensorFlow Serving [html]

Note

To use Jupyter Notebook see:

• Jupyter Notebook QuickStart

• Running Jupyter Notebook as script

Additional Examples (tensorflow-neuron)

• AWS Neuron Samples GitHub Repository

API Reference Guide (tensorflow-neuron)

• TensorFlow 2.x (tensorflow-neuron) Tracing API

• TensorFlow 2.x (tensorflow-neuron) analyze_model API

• TensorFlow 2.x (tensorflow-neuron) Auto Multicore Replication (Beta)

Misc (tensorflow-neuron)

• TensorFlow 2.x (tensorflow-neuron) Release Notes

• TensorFlow 2.x (tensorflow-neuron) Accelerated (torch-neuron) Python APIs and Graph Ops

This document is relevant for: Inf1