Introducing Packaging and installation changes
Contents
This document is relevant for: Inf1, Inf2, Trn1, Trn1n
Introducing Packaging and installation changes#
Starting with Neuron release 2.3, Neuron introduces changes in Neuron packages and installation instructions.
Table of contents
New Neuron packages#
Starting with Neuron release 2.3, Neuron introduces the following new packages:
New Package |
Package Type |
Description |
Supported Instances (At the time of releasing Neuron release 2.3) |
|---|---|---|---|
|
.whl (pip) |
PyTorch Neuron package using PyTorch XLA |
Trn1 |
|
.whl (pip) |
Neuron Compiler with XLA front-end |
Trn1 |
|
.deb (apt), .rpm (yum) |
Neuron Runtime library |
Trn1 |
|
.deb (apt), .rpm (yum) |
Collective Communication library |
Trn1 |
|
.deb (apt), .rpm (yum) |
Neuron System Tools |
Trn1 |
Note
In next releases aws-neuronx-tools and aws-neuronx-runtime-lib will add support for Inf1.
Why are we introducing new Neuron packages?#
To add Neuron support for training neural-networks, Neuron 2.x introduces new capabilities and major architectural updates. For example, Neuron adds support for Collective Communication Operations, in new packages such as aws-neuron-collective.
In addition, some of those updates and new capabilities are not backward compatible, for example the Pytorch Neuron package that adds support for training neural-networks uses PyTorch XLA as a backend. To reduce the possibility of customers using features that are not backward compatible, the new capabilities are introduced in new Neuron packages. For example, PyTorch Neuron and Neuron Compiler will support different packages for Inf1 and for Trn1: torch-neuron and neuron-cc will support Inf1 instances, and torch-neuronx and neuronx-cc will support Trn1 instances.
Renamed Neuron Packages#
Starting with Neuron release 2.3, the following Neuron packages will change names:
New name |
Old name (deprecated package) |
Package Type |
Description |
Supported Instances |
|---|---|---|---|---|
|
|
.deb (apt), .rpm (yum) |
OCI Hooks support |
Trn1, Inf1 |
|
|
.deb (apt), .rpm (yum) |
Neuron Driver |
Trn1, Inf1 |
|
|
.deb (apt), .rpm (yum) |
Neuron Kubernetes plugin |
Trn1, Inf1 |
|
|
.deb (apt), .rpm (yum) |
Neuron Scheduler plugin |
Trn1, Inf1 |
Why are we changing package names?#
To avoid situations where customers may accidentally install Neuron packages with features that are not backward compatible, we have introduced additional packages with different names for the same Neuron component.
Updated installation and update instructions#
Starting with Neuron release 2.3, Neuron installation and update instructions will include pinning of the major version of the Neuron package. For example, to install latest Neuron tools package, call sudo apt-get install aws-neuronx-tools=2.* and to install latest PyTorch Neuron package for Trn1, call pip install torch-neuronx==1.11.0.1.*.
Why are we changing installation and update instructions?#
The Neuron installation and update instructions now guide customers to pin the major version of the different Neuron packages as mentioned in Updated installation and update instructions. This is done to future-proof instructions for new, backwards-incompatible major version releases.
Note
The change of the installation and update instructions will not include instruction to install or update torch-neuron and neuron-cc.
What do I need to do?#
Please follow the Neuron setup guide to update to latest Neuron releases.
This document is relevant for: Inf1, Inf2, Trn1, Trn1n