This document is relevant for: Inf2, Trn1, Trn1n

Tutorials for Inference (torch-neuronx)

• HuggingFace pretrained BERT tutorial [html] [notebook]

• TorchServe tutorial [html]

• LibTorch C++ tutorial (for torch-neuron and torch-neuronx) [html]

• Torchvision ResNet50 tutorial [html] [notebook]

• T5 inference tutorial [html] [notebook]

Note

To use Jupyter Notebook see:

• Jupyter Notebook QuickStart

• Running Jupyter Notebook as script

This document is relevant for: Inf2, Trn1, Trn1n