Inference
=========

.. toctree::
    :maxdepth: 2
    :hidden:

    Inference with torch-neuronx (Inf2 & Trn1) </frameworks/torch/inference-torch-neuronx>
    Inference with torch-neuron (Inf1) </frameworks/torch/inference-torch-neuron>
    /frameworks/torch/guide-torch-neuron-vs-torch-neuronx-inference.rst

.. note::

    For help selecting a framework type, see:

    :ref:`torch-neuron_vs_torch-neuronx`


Inference on Inf2 & Trn1/Trn1n
------------------------------

.. card:: PyTorch Neuron(``torch-neuronx``) for Inference
    :link: inference-torch-neuronx
    :link-type: ref
    :class-body: sphinx-design-class-title-small


Inference on Inf1
-----------------

.. card:: PyTorch Neuron(``torch-neuron``) for Inference
    :link: inference-torch-neuron
    :link-type: ref
    :class-body: sphinx-design-class-title-small