This document is relevant for: Inf2, Trn1, Trn1n

Neuron Custom C++ Operators

Neuron Custom C++ Operators enable developers to write C++ Custom Operators (“CustomOps”) that run on NeuronCores. This enables developers to extend operator support beyond what is officially supported by Neuron.

Developers can use standard PyTorch custom operators programming interfaces to leverage Neuron Custom C++ Operators feature. This makes it easy to migrate CPU Custom Operators to Neuron, and implement new experimental operators, all without any intimate knowledge of the NeuronCore hardware.

For more details see Neuron Custom C++ Operators [Experimental]

This document is relevant for: Inf2, Trn1, Trn1n