Neuron 2.24.0 is released! Check What's New and Announcements for more details.

Neuron no longer supports nki_jit API in PyTorch Neuron starting this release

This document is relevant for: Inf1, Inf2, Trn1, Trn2

Neuron no longer supports nki_jit API in PyTorch Neuron starting this release#

Starting with Neuron Release 2.24, torch_neuronx.nki_jit API in torch-neuronx package is no longer supported.

I currently use nki_jit in my PyTorch models. What do I do?

Customers using torch_neuronx.nki_jit API are recommended to switch invocations to directly call functions annotated with nki.jit API.

This document is relevant for: Inf1, Inf2, Trn1, Trn2