This document is relevant for: Inf2, Trn1, Trn1n

Training Samples/Tutorials (Trn1/Trn1n)#

Decoders#

Model

Frameworks/Libraries

Samples and Tutorials

gpt-2

torch-neuronx

gpt-3

neuronx-nemo-megatron

GPT-NEOX-20B

neuronx-distributed

GPT-NEOX-6.9B

neuronx-distributed

meta-llama/Llama-3-8b

neuronx-distributed

meta-llama/Llama-2-7b

neuronx-distributed

meta-llama/Llama-2-13b

neuronx-distributed

meta-llama/Llama-2-70b

neuronx-distributed

codegen25-7b-mono

neuronx-distributed

meta-llama/Llama-2

neuronx-nemo-megatron

Mistral-7B

neuronx-nemo-megatron

Encoder-Decoders#

Model

Frameworks/Libraries

Samples and Tutorials

t5-small

  • torch-neuronx

  • optimum-neuron

facebook/bart-large

  • torch-neuronx

Vision Transformers#

Model

Frameworks/Libraries

Samples and Tutorials

google/vit-base-patch16-224-in21k

torch-neuronx

openai/clip-vit-base-patch32

torch-neuronx

openai/clip-vit-large-patch14

torch-neuronx

Stable Diffusion#

Model

Frameworks/Libraries

Samples and Tutorials

stabilityai/stable-diffusion-2-1-base

torch-neuronx

runwayml/stable-diffusion-v1-5

torch-neuronx

Multi Modal#

Model

Frameworks/Libraries

Samples and Tutorials

language-perceiver

torch-neuronx

vision-perceiver-conv

torch-neuronx