Posts tagged announce-eos-vllm-neuron-torch-xla

Announcing end of support for the Torch/XLA path in the vLLM Neuron plugin on Trn2 and Trn3 starting in Neuron 2.34

As part of the transition to native PyTorch support on Trainium, native PyTorch support through TorchNeuron is the default execution path in the vLLM Neuron plugin starting with Neuron Release 2.33.

Starting with Neuron Release 2.34, Neuron will end support for the Torch/XLA path in the vLLM Neuron plugin on Trn2 and Trn3 instances.