What’s New
Contents
This document is relevant for: Inf1
, Trn1
What’s New#
Table of contents
Neuron 2.6.0 (12/12/2022)#
Table of contents
What’s New#
This release introduces the support of PyTorch 1.12 version, and introduces PyTorch Neuron (torch-neuronx
) profiling through Neuron Plugin for TensorBoard. Pytorch Neuron (torch-neuronx
) users can now profile their models through the following TensorBoard views:
Operator Framework View
Operator HLO View
Operator Trace View
This release introduces the support of LAMB optimizer for FP32 mode, and adds support for capturing snapshots of inputs, outputs and graph HLO for debugging.
In addition, this release introduces the support of new operators and resolves issues that improve stability for Trn1 customers.
For more detailed release notes of the new features and resolved issues, see Neuron Components Release Notes.
Neuron Components Release Notes#
Inf1 and Trn1 common packages#
Component |
Instance/s |
Package/s |
Details |
---|---|---|---|
Neuron Runtime |
Trn1 , Inf1 |
|
|
Neuron Runtime Driver |
Trn1, Inf1 |
|
|
Neuron System Tools |
Trn1, Inf1 |
|
|
Containers |
Trn1, Inf1 |
|
|
NeuronPerf (Inference only) |
Trn1, Inf1 |
|
Trn1 only packages#
Component |
Instance/s |
Package/s |
Details |
---|---|---|---|
PyTorch Neuron |
Trn1 |
|
|
Neuron Compiler (Trn1 only) |
Trn1 |
|
|
Collective Communication library |
Trn1 |
|
Note
In next releases aws-neuronx-tools
and aws-neuronx-runtime-lib
will add support for Inf1.
Inf1 only packages#
Component |
Instance/s |
Package/s |
Details |
---|---|---|---|
PyTorch Neuron |
Inf1 |
|
|
TensorFlow Neuron |
Inf1 |
|
|
TensorFlow Model Server Neuron |
Inf1 |
|
|
Apache MXNet (Incubating) |
Inf1 |
|
|
Neuron Compiler (Inf1 only) |
Inf1 |
|
Previous Releases#
This document is relevant for: Inf1
, Trn1