NKI Library Documentation

The NKI Library is a collection of pre-built kernels optimized for AWS Neuron-powered devices. These kernels are designed to accelerate machine learning workloads by providing efficient implementations of common operations used in deep learning models.

NKI Library GitHub repository: aws-neuron/nki-library

Tutorial: Use a Pre-built NKI Library Kernel

Learn how to integrate an optimized multi-layer perceptron (MLP) kernel into your PyTorch model as an example use case.

NKI Library Kernel Design Specs

Review the formal specifications for the pre-built NKI kernels available in the NKI Library.

NKI Library Kernel API Reference

Use the Kernel API reference to understand the functions, parameters, and usage of the pre-built NKI kernels in the NKI Library .

• Kernel API Reference