Posts tagged announcement-end-of-support-vllm-v0

Announcing End of Support for vLLM V0 starting with Neuron 2.28

Neuron Release 2.27 will be the last release to support vLLM V0. In Neuron 2.27 release, vLLM V1 support is introduced for Neuron using the vllm-neuron plugin. Review the sources in the Neuron vLLM GitHub Repository.

Starting with the Neuron 2.28 release, vLLM V0 will not be supported. Support will be dropped for vLLM V0 Neuron forks of the upstreaming-to-vllm Neuron GitHub repo, along with vLLM V0-based Neuron Inference Deep Learning Containers.

Read more ...