Neuron 2.31.0 is released! Check the What's New and Release Notes for more details.

Neuron no longer supports implicit asynchronous mode starting with Neuron 2.31.0

Neuron no longer supports implicit asynchronous mode starting with Neuron 2.31.0#

Starting with Neuron SDK 2.31.0, implicit asynchronous execution mode has been removed from the Neuron Runtime. The NEURON_RT_ASYNC_EXEC_MAX_INFLIGHT_REQUESTS environment variable no longer enables asynchronous execution and now emits a deprecation warning.

Customers using the implicit request async APIs must migrate their code to the explicit Neuron Runtime async APIs. For details on the new APIs, see Neuron Runtime Async APIs: Motivation and Overview.