This document is relevant for: Trn2, Trn3

NKI Library Documentation

The NKI Library is a collection of pre-built kernels optimized for AWS Neuron-powered devices. These kernels are designed to accelerate machine learning workloads by providing efficient implementations of common operations used in deep learning models.

NKI Library GitHub repository: aws-neuron/nki-library

NKI Library Kernel Design Specs

Review the formal specifications for the pre-built NKI kernels available in the NKI Library.

NKI Library Supported Kernel Reference

Use this kernel reference to understand the functions, parameters, and usage of the pre-built NKI kernels in the NKI Library.

NKI Library Kernel Utilities

Utility modules for memory management, tensor views, and iteration helpers used in NKI kernel development.

NKI Library Release Notes

Release notes for the NKI Library kernels and APIs.

This document is relevant for: Trn2, Trn3