Inference with torch-neuronx (Inf2 & Trn1/Trn1n)
Inference with torch-neuronx
(Inf2 & Trn1/Trn1n)#
Tutorials (torch-neuronx
)
HuggingFace pretrained BERT tutorial [html] [notebook]
TorchServe tutorial [html]
LibTorch C++ tutorial (for torch-neuron and torch-neuronx) [html]
Torchvision ResNet50 tutorial [html] [notebook]