Neuron runtime FAQ

What will happen if I will upgrade Neuron Framework without upgrading latest kernel mode driver?

Application start would fail with the following error message: .. code:: bash

2021-Aug-11 19:18:21.0661 24616:24616 ERROR NRT:nrt_init This runtime requires Neuron Driver version 2.0 or greater. Please upgrade aws-neuron-dkms package.

Do I need to recompile my model to use the Runtime Library?

No. Runtime 2.x supports all the models compiled with Neuron Compiler 1.x.

How do I restart/start/stop the Neuron Runtime?

Since Neuron Runtime is a library, starting/stopping application would result in starting/stopping the Neuron Runtime.

How do I know which runtimes are associated with which Neuron Device(s)?

neuron-ls and neuron-top can be used to find out applications using Neuron Devices.

How can I use Neuron in a container based environment? Does Neuron work with ECS and EKS?

ECS and EKS support is coming soon. Containers can be configured as shown here.