This document is relevant for: Inf2
, Trn1
, Trn1n
nki#
Framework#
Simulate a nki kernel on CPU using a built-in simulator in Neuron Compiler. |
Benchmark a NKI kernel on a NeuronDevice by using |
|
Compile and run a NKI kernel on NeuronDevice without involving ML frameworks such as PyTorch and JAX. |
NKI kernels are represeted as XLA CustomCall instructions in HLO. |
Types#
A tensor object represents a multidimensional, homogeneous array of fixed-size items |
This document is relevant for: Inf2
, Trn1
, Trn1n