Inference
=========

.. toctree::
    :maxdepth: 2
    :hidden:

    Inference with torch-neuronx (Inf2 & Trn1) </frameworks/torch/inference-torch-neuronx>
    Inference with torch-neuron (Inf1) </frameworks/torch/inference-torch-neuron>
    /frameworks/torch/guide-torch-neuron-vs-torch-neuronx-inference.rst

.. note::

    For help selecting a framework type, see:

    :ref:`torch-neuron_vs_torch-neuronx`

.. tab-set::

    .. tab-item:: Inference on Inf2 & Trn1 (``torch-neuronx``)

        .. include:: inference-torch-neuronx.txt

    .. tab-item:: Inference on Inf1 (``torch-neuron``)

        .. include:: inference-torch-neuron.txt