This document is relevant for: Inf1, Inf2, Trn1, Trn2

ONNX FAQ

Can I use ONNX models with Neuron ? If not, what should I do?

AWS Neuron does not directly support compilation of models in the ONNX file format. The recommended way to compile a model that is in the ONNX file format is to first convert the model to PyTorch using a publicly available tool like onnx2pytorch . Once the ONNX model is converted to PyTorch, it can then be compiled with the torch_neuron.trace() function to produce a model that can run on Neuron.

This document is relevant for: Inf1, Inf2, Trn1, Trn2