This document is relevant for: Inf1

Tutorials for Inference with torch-neuron (Inf1)

Computer Vision Tutorials

• ResNet-50 tutorial [html] [notebook]

• PyTorch YOLOv4 tutorial [html] [notebook]

Natural Language Processing (NLP) Tutorials

• HuggingFace pretrained BERT tutorial [html] [notebook]

• HuggingFace pretrained BERT tutorial with shared weights [html] [notebook]

• Bring your own HuggingFace pretrained BERT container to Sagemaker Tutorial [html] [notebook]

• LibTorch C++ tutorial [html]

• TorchServe tutorial [html]

• HuggingFace MarianMT tutorial [html] [notebook]

Utilizing Neuron Capabilities Tutorials

• BERT TorchServe tutorial [html]

• NeuronCore Pipeline tutorial [html] [notebook]

Note

To use Jupyter Notebook see:

• Jupyter Notebook QuickStart

• Running Jupyter Notebook as script

This document is relevant for: Inf1