Tensorflow-Neuron 2.x Release Notes

This document lists the release notes for the TensorFlow-Neuron 2.x packages.

Known Issues and Limitations - updated 08/12/2021

  • Support on serialized TensorFlow 2.x custom operators is currently limited. Serializing some operators registered from tensorflow-text through TensorFlow Hub is going to cause failure in tensorflow.neuron.trace.

  • Issue: When compiling large models, user might run out of memory and encounter this fatal error.

terminate called after throwing an instance of 'std::bad_alloc'

Solution: run compilation on a c5.4xlarge instance type or larger.

  • Issue: When upgrading tensorflow-neuron with pip install tensorflow-neuron --upgrade, the following error message may appear, which is caused by pip version being too low.

Could not find a version that satisfies the requirement tensorflow<1.16.0,>=1.15.0 (from tensorflow-neuron)

Solution: run a pip install pip --upgrade before upgrading tensorflow-neuron.

  • Issue: Some Keras routines throws the following error:

AttributeError: 'str' object has no attribute 'decode'.

Solution: Please downgrade h5py by pip install ‘h5py<3’. This is caused by https://github.com/tensorflow/tensorflow/issues/44467.

Tensorflow-Neuron 2.x release [2.1.6.0]

Date: 01/20/2022

  • Updated Tensorflow 2.5 to version 2.5.2.

  • Enhanced auto data parallel (e.g. when using NEURONCORE_GROUP_SIZES=X,Y,Z,W) to support edge cases.

  • Fixed a bug that may cause tensorflow-neuron to generate in some cases scalar gather instruction with incorrect arguments.

Tensorflow-Neuron 2.x release [2.0.4.0]

Date: 11/05/2021

  • Updated Neuron Runtime (which is integrated within this package) to libnrt 2.2.18.0 to fix a container issue that was preventing the use of containers when /dev/neuron0 was not present. See details here Neuron Runtime 2.x Release Notes.

Tensorflow-Neuron 2.x release [2.0.3.0]

Date: 10/27/2021

New in this release

Resolved Issues

  • Fix bug that can cause illegal compiler optimizations

  • Fix bug that can cause dynamic-shape operators be placed on Neuron

Tensorflow-Neuron 2.x release [1.6.8.0]

Date: 08/12/2021

New in this release

  • First release of TensorFlow 2.x integration, Neuron support now TensorFlow versions 2.1.4, 2.2.3, 2.3.3, 2.4.2, and 2.5.0.

  • New public API tensorflow.neuron.trace: trace a TensorFlow 2.x keras.Model or a Python callable that can be decorated by tf.function, and return an AWS-Neuron-optimized keras.Model that can execute on AWS Machine Learning Accelerators.

Please note that TensorFlow 1.x SavedModel compilation API tensorflow.neuron.saved_model.compile is not supported in tensorflow-neuron 2.x . It continues to function in tensorflow-neuron 1.15.x .

  • Included versions:

    • tensorflow-neuron-2.5.0.1.6.8.0

    • tensorflow-neuron-2.4.2.1.6.8.0

    • tensorflow-neuron-2.3.3.1.6.8.0

    • tensorflow-neuron-2.2.3.1.6.8.0

    • tensorflow-neuron-2.1.4.1.6.8.0