NKI Kernels
==============

.. _nki_kernels:

nki.kernels
-------------

The source code of the kernels in the `neuronxcc.nki.kernels` namespace 
is available at the GitHub Repository `nki-samples <https://github.com/aws-neuron/nki-samples>`_. 
They are optimized kernels from the Neuron Team serving as samples. The repository also contains
numeric tests, performance benchmarks, as well as scripts to use them in real models.

You are welcome to customize them to fit your unique workloads, and contributing to the repository by opening a PR. 
Note that these kernels are already being deployed as part of the Neuron stack. 

See the `README <https://github.com/aws-neuron/nki-samples>`_ page 
of the GitHub Repository `nki-samples <https://github.com/aws-neuron/nki-samples>`_ for more details.

The documentation of the kernels is available at https://aws-neuron.github.io/nki-samples.