Tutorials for Inference with torch-neuron (Inf1)#
Warning
This document is archived. torch-neuron (Inf1) is no longer officially supported by the AWS Neuron SDK. It is provided for reference only. For current framework support, see ML framework support on AWS Neuron SDK.
ResNet-50 tutorial [html] [notebook]
PyTorch YOLOv4 tutorial [html] [notebook]
HuggingFace pretrained BERT tutorial [html] [notebook]
HuggingFace pretrained BERT tutorial with shared weights [html] [notebook]
Bring your own HuggingFace pretrained BERT container to Sagemaker Tutorial [html] [notebook]
LibTorch C++ tutorial [html]
TorchServe tutorial [html]
HuggingFace MarianMT tutorial [html] [notebook]
BERT TorchServe tutorial [html]
NeuronCore Pipeline tutorial [html] [notebook]