This document is relevant for: Inf1, Trn1

What’s New

Neuron 2.6.0 (12/12/2022)

What’s New

This release introduces the support of PyTorch 1.12 version, and introduces PyTorch Neuron (torch-neuronx) profiling through Neuron Plugin for TensorBoard. Pytorch Neuron (torch-neuronx) users can now profile their models through the following TensorBoard views:

• Operator Framework View

• Operator HLO View

• Operator Trace View

This release introduces the support of LAMB optimizer for FP32 mode, and adds support for capturing snapshots of inputs, outputs and graph HLO for debugging.

In addition, this release introduces the support of new operators and resolves issues that improve stability for Trn1 customers.

For more detailed release notes of the new features and resolved issues, see Neuron Components Release Notes.

Neuron Components Release Notes

Inf1 and Trn1 common packages

Component	Instance/s	Package/s	Details
Neuron Runtime	Trn1 , Inf1	Trn1: aws-neuronx-runtime-lib (.deb, .rpm) Inf1: Runtime is linked into the ML frameworks packages	Neuron Runtime Release Notes
Neuron Runtime Driver	Trn1, Inf1	aws-neuronx-dkms (.deb, .rpm)	Neuron Driver Release Notes
Neuron System Tools	Trn1, Inf1	aws-neuronx-tools (.deb, .rpm)	Neuron System Tools
Containers	Trn1, Inf1	aws-neuronx-k8-plugin (.deb, .rpm) aws-neuronx-k8-scheduler (.deb, .rpm) aws-neuronx-oci-hooks (.deb, .rpm)	Neuron K8 Release Notes Neuron Containers Release Notes
NeuronPerf (Inference only)	Trn1, Inf1	neuronperf (.whl)	NeuronPerf 1.x Release Notes

Trn1 only packages

Component	Instance/s	Package/s	Details
PyTorch Neuron	Trn1	torch-neuronx (.whl)	PyTorch Neuron (torch-neuronx) release notes PyTorch Neuron (torch-neuronx) - Training Supported Operators
Neuron Compiler (Trn1 only)	Trn1	neuronx-cc (.whl)	Neuron Compiler (neuronx-cc) release notes
Collective Communication library	Trn1	aws-neuronx-collective (.deb, .rpm)	Neuron Collectives Release Notes

Note

In next releases aws-neuronx-tools and aws-neuronx-runtime-lib will add support for Inf1.

Inf1 only packages

Component	Instance/s	Package/s	Details
PyTorch Neuron	Inf1	torch-neuron (.whl)	PyTorch Neuron (torch-neuron) release notes PyTorch Neuron (torch-neuron) Supported operators
TensorFlow Neuron	Inf1	tensorflow-neuron (.whl)	TensorFlow Neuron (tensorflow-neuron (TF1.x)) Release Notes TensorFlow Neuron (tensorflow-neuron (TF1.x)) Supported operators
TensorFlow Model Server Neuron	Inf1	tensorflow-model-server-neuronx (.deb, .rpm)	TensorFlow-Model-Server-Neuron 1.x Release Notes
Apache MXNet (Incubating)	Inf1	mx_neuron (.whl)	Apache MXNet Neuron (Incubating) Release Notes Neuron Apache MXNet (Incubating) Supported operators
Neuron Compiler (Inf1 only)	Inf1	neuron-cc (.whl)	Neuron Compiler (neuron-cc) for Inf1 Release Notes Neuron Supported operators

Previous Releases

• Previous Releases Notes (Neuron 2.x)

• Previous Release Notes (Neuron 1.x)

This document is relevant for: Inf1, Trn1