.. _transformers_neuronx_tutorials:

Transformers NeuronX Tutorials 
===============================

.. toctree::
    :maxdepth: 1
    :hidden:

    Hugging Face meta-llama/Llama-2-13b autoregressive sampling on Inf2 & Trn1 <https://github.com/aws-neuron/aws-neuron-samples/blob/master/torch-neuronx/transformers-neuronx/inference/meta-llama-2-13b-sampling.ipynb>
    Hugging Face facebook/opt-13b autoregressive sampling on Inf2 & Trn1 <https://github.com/aws-neuron/aws-neuron-samples/blob/master/torch-neuronx/transformers-neuronx/inference/facebook-opt-13b-sampling.ipynb>
    Hugging Face facebook/opt-30b autoregressive sampling on Inf2 & Trn1 <https://github.com/aws-neuron/aws-neuron-samples/blob/master/torch-neuronx/transformers-neuronx/inference/facebook-opt-30b-sampling.ipynb>
    Hugging Face facebook/opt-66b autoregressive sampling on Inf2 <https://github.com/aws-neuron/aws-neuron-samples/blob/master/torch-neuronx/transformers-neuronx/inference/facebook-opt-66b-sampling.ipynb>


.. include:: /libraries/transformers-neuronx/transformers-neuronx-tutorials.txt