This document is relevant for: Inf1

Inference Samples/Tutorials (Inf1)#

Encoders#

Model

Frameworks/Libraries

Samples and Tutorials

bert-base-cased-finetuned-mrpc

torch-neuron

bert-base-uncased

torch-neuron

bert-large-uncased

torch-neuron

roberta-base

torch-neuron

distilbert-base-uncased-finetuned-sst-2-english

tensorflow-neuron

  • Tensorflow 2.x - HuggingFace Pipelines distilBERT with Tensorflow2 Neuron [html] [notebook]

gluon bert

mxnet-neuron

Vision Transformers#

Model

Frameworks/Libraries

Samples and Tutorials

ssd

torch-neuron

TrOCR

torch-neuron

vgg

torch-neuron

google/vit-base-patch16-224

torch-neuron

Convolutional Neural Networks(CNN)#

Model

Frameworks/Libraries

Samples and Tutorials

EfficientNet

torch-neuron

GFL (MMDetection)

torch-neuron

HRNet

torch-neuron

MarianMT

torch-neuron

Detectron2 R-CNN

torch-neuron

resnet

torch-neuron

resnet

tensorflow-neuron

  • Tensorflow 2.x - Using NEURON_RT_VISIBLE_CORES with TensorFlow Serving [html]

resnet

mxnet-neuron

Resnext

torch-neuron

Yolov4

torch-neuron

Yolov5

torch-neuron

Yolov6

torch-neuron

Yolov7

torch-neuron

Yolof

torch-neuron

fairseq

torch-neuron

unet

tensorflow-neuron

Vision#

Model

Frameworks/Libraries

Samples and Tutorials

craft-pytorch

torch-neuron

This document is relevant for: Inf1