ONNX FAQ
Contents
This document is relevant for: Inf1, Inf2, Trn1, Trn1n
ONNX FAQ#
Table of contents
Can I use ONNX models with Neuron ? If not, what should I do?#
AWS Neuron does not directly support compilation of models in the ONNX file format. The recommended way to compile a model that is in the ONNX file format is to first convert the model to PyTorch using a publicly available tool
like onnx2pytorch . Once the ONNX model is converted to PyTorch, it can then be compiled with the torch_neuron.trace() function to produce a model that can run on Neuron.
This document is relevant for: Inf1, Inf2, Trn1, Trn1n