This document is relevant for: Inf2, Trn1, Trn1n

Neuron Custom C++ Operators [Beta]

Neuron Custom C++ Operators enable developers to write C++ Custom Operators (“CustomOps”) that run on NeuronCores. This enables developers to extend operator support beyond what is officially supported by Neuron.

Developers can use standard PyTorch custom operators programming interfaces to leverage Neuron Custom C++ Operators feature. This makes it easy to migrate CPU Custom Operators to Neuron, and implement new beta operators, all without any intimate knowledge of the NeuronCore hardware.

Note

Neuron Custom C++ Operators feature is available only starting from second generation of NeuronCore (NeuronCore-v2)

API Reference Guide

• Custom Operators API Reference Guide [Beta]

Developer Guide

• Neuron Custom C++ Operators Developer Guide [Beta]

Tutorials

• Neuron Custom C++ Operators in MLP Training

• Neuron Custom C++ Operators Performance Optimization

Misc

• Neuron Custom C++ Tools Release Notes

• Neuron Custom C++ Library Release Notes

This document is relevant for: Inf2, Trn1, Trn1n