This document is relevant for: Inf2, Trn1, Trn1n

TensorFlow Neuron (tensorflow-neuronx) Release Notes#

This document lists the release notes for the tensorflow-neuronx 2.x packages.

tensorflow-neuronx 2.x release [2.1.0]#

Date: 09/15/2023

  • Minor updates

Date: 05/1/2023

  • Added support for tracing models larger than 2 GB through the environment variable NEURON_CC_FLAGS='--extract-weights INSTANCE_TYPE' for all trn1 and inf2 instance types.

  • tensorflow-neuronx now supports tensorflow 2.7, 2.8, and 2.9 (In addition to the already supported 2.10).

  • Neuron release 2.10 release will be the last release that will include support for tensorflow-neuronx version 2.7. Future Neuron releases will not include tensorflow-neuronx version 2.7.

tensorflow-neuronx 2.10 release [2.0.0]#

Date: 03/28/2023

The second release of tensorflow-neuronx 2.10 includes the following features:

  • Dynamic batching

The following features are not included in this release:

  • Support for tracing models larger than 2 GB

tensorflow-neuronx 2.10 release [1.0.0]#

Date: 2/24/2023

The initial release of tensorflow-neuronx 2.10 includes the following features:

  • Initial support for TensorFlow 2.10 inference on Inf2 and Trn1

  • Trace API (tensorflow_neuronx.trace)

  • Automatic partitioning of model into CPU vs NeuronCore parts

  • Automatic data parallel on multiple NeuronCores (beta)

  • Python 3.7, 3.8 and 3.9 support

  • HuggingFace Roberta tutorial

The following features are not included in this release:

  • Dynamic batching

  • Support for tracing models larger than 2 GB

This document is relevant for: Inf2, Trn1, Trn1n