This document is relevant for: Inf2, Trn1

Transformers NeuronX (transformers-neuronx)

Important

As of 9/16/2025, support has ended for the Transformers NeuronX library and the corresponding documentation has been archived. If you are still using Transformers NeuronX, Neuron recommends that you migrate to the NxD Inference library, which provides a PyTorch-based inference library. Refer to the migration guide to learn how to migrate your Transformers NeuronX workloads to NxD Inference.

To view the archived Transformers NeuronX documentation, including setup instructions and developer guides, see the Transformers NeuronX documentation.

This document is relevant for: Inf2, Trn1