What’s New

Neuron 1.15.2 (09/22/2021)

Neuron 1.15.2 includes bug fixes for the tensorflow-model-server-neuron 2.5.1.1.6.8.0 package and several other bug fixes for tensorflow-neuron/tensorflow-model-server-neuron packages.

Neuron 1.15.1 (08/30/2021)

Neuron 1.15.1 includes bug fixes for the aws-neuron-dkms package and several other bug fixes for related packages.

Neuron 1.15.0 (08/12/2021)

Neuron 1.15.0 is the first release to support TensorFlow 2. In this release TensorFlow 2 supports language transformer base models like BERT. The TensorFlow 2 support will be enhanced in future releases to support additional models.

• TensorFlow 2.x - To get started with TensorFlow 2.x:

  • Run the TensorFlow 2 HuggingFace distilBERT Tutorial.

  • Read TensorFlow 2.x FAQ

  • See newly introduced TensorFlow-Neuron 2.x Tracing API.

  • See Accelerated TensorFlow 2.x Python APIs and Graph Ops.

• Documentation

  • New Inferentia Model Architecture Fit application note added in this release. This application note describes what types of deep learning model architectures perform well out of the box and provides guidance on techniques you can use to optimize your deep learning models for Inferentia.

  • New Neuron inference performance page provides performance information for popular models and links to test these models in your own environment. The data includes throughout and latency numbers, cost per inference, for both realtime and offline applications.

  • New TensorFlow 2 HuggingFace distilBERT Tutorial.

  • New Bring your own HuggingFace pretrained BERT container to Sagemaker Tutorial.

• More information

  • Tensorflow-Neuron Release Notes

  • Neuron Compiler Release Notes

  • TensorFlow-Model-Server-Neuron Release Notes

Detailed release notes

Software	Details
General	Release Details Software deprecation
PyTorch	PyTorch Neuron release notes Supported operators [PyTorch]
TensorFlow	Tensorflow-Neuron Release Notes Accelerated TensorFlow 2.x Python APIs and Graph Ops Supported operators [TensorFlow 1.x] TensorFlow-Model-Server-Neuron Release Notes
Apache MXNet (Incubating)	Neuron Apache MXNet (Incubating) Release Notes Supported operators [Neuron Apache MXNet (Incubating)]
Compiler	Neuron Compiler Release Notes
Runtime	Neuron Runtime Release Notes
Tools	Neuron Tools Release Notes Neuron Plugin for TensorBoard Release Notes
DLAMI and Conda Packages	DLAMI with Neuron Release Notes DLAMI and Neuron versions Matrix
Software Deprecation	Software deprecation

Previous Releases

• Previous Neuron Release Notes