This document is relevant for: Trn2, Trn3

nki.compiler#

The nki.compiler module provides the public per-kernel configuration passed to nki.jit().

Per-kernel config#

Passed to the nki.jit() decorator as @nki.jit(compile_config=CompileConfig(...), specialization_config=SpecializationConfig(...)). CompileConfig holds options that impact downstream compiler behavior; SpecializationConfig holds options that tune the specialization phase.

CompileConfig

Per-kernel compile configuration passed to @nki.jit(compile_config=...).

SpecializationConfig

Per-kernel specialization-time config passed to @nki.jit(specialization_config=...).

AddressRotation

Whether the backend may rotate a memloc's address for better layout.

This document is relevant for: Trn2, Trn3