This document is relevant for: Trn2, Trn3

vLLM Neuron Release Notes

Latest version (in 2.32.0): v0.24.0.1.1.0 (Beta)

vLLM Neuron is an open-source vLLM plugin for high-performance LLM inference serving on AWS Trainium. For an introduction, see vLLM Neuron Plugin (Beta) Documentation.

For the release notes, see the vLLM Neuron releases on GitHub.

This document is relevant for: Trn2, Trn3