.. _transformers_neuronx_tutorials:

.. meta::
   :noindex:
   :nofollow:
   :description: This topic is currently archived and not maintained. It is provided for reference only.

Transformers NeuronX Tutorials 
===============================

.. toctree::
    :maxdepth: 1
    :hidden:

    Hugging Face meta-llama/Llama-2-13b autoregressive sampling on Inf2 & Trn1 <https://github.com/aws-neuron/aws-neuron-samples/blob/master/torch-neuronx/transformers-neuronx/inference/meta-llama-2-13b-sampling.ipynb>
    Hugging Face facebook/opt-13b autoregressive sampling on Inf2 & Trn1 <https://github.com/aws-neuron/aws-neuron-samples/blob/master/torch-neuronx/transformers-neuronx/inference/facebook-opt-13b-sampling.ipynb>
    Hugging Face facebook/opt-30b autoregressive sampling on Inf2 & Trn1 <https://github.com/aws-neuron/aws-neuron-samples/blob/master/torch-neuronx/transformers-neuronx/inference/facebook-opt-30b-sampling.ipynb>
    Hugging Face facebook/opt-66b autoregressive sampling on Inf2 <https://github.com/aws-neuron/aws-neuron-samples/blob/master/torch-neuronx/transformers-neuronx/inference/facebook-opt-66b-sampling.ipynb>


.. include:: /libraries/transformers-neuronx/transformers-neuronx-tutorials.txt