This document is relevant for: Inf2
, Trn1
, Trn2
Tutorials for Inference (torch-neuronx
)#
HuggingFace pretrained BERT tutorial [html] [notebook]
TorchServe tutorial [html]
LibTorch C++ tutorial (for torch-neuron and torch-neuronx) [html]
Torchvision ResNet50 tutorial [html] [notebook]
T5 inference tutorial [html] [notebook]
This document is relevant for: Inf2
, Trn1
, Trn2