Posts tagged neuron-runtime
Neuron no longer supports implicit asynchronous mode starting with Neuron 2.31.0
- 28 June 2026
Starting with Neuron SDK 2.31.0, implicit asynchronous execution mode has been removed from the Neuron Runtime. The NEURON_RT_ASYNC_EXEC_MAX_INFLIGHT_REQUESTS environment variable no longer enables asynchronous execution and now emits a deprecation warning.
Customers using the implicit request async APIs must migrate their code to the explicit Neuron Runtime async APIs. For details on the new APIs, see Neuron Runtime Async APIs: Motivation and Overview.
Announcing end-of-support for implicit asynchronous mode in Neuron Runtime
- 21 May 2026
A future release of the Neuron SDK will remove support for implicit asynchronous
mode, including the NEURON_RT_ASYNC_EXEC_MAX_INFLIGHT_REQUESTS environment
variable.
Customers using the implicit request async APIs must migrate their code and calls to the new Neuron Runtime async APIs. For details on the new APIs, see Neuron Runtime Async APIs: Motivation and Overview.