What’s New¶
Neuron 1.15.1 (08/30/2021)¶
Neuron 1.15.1 includes bug fixes for the aws-neuron-dkms package and several other bug fixes for related packages.
Neuron 1.15.0 (08/12/2021)¶
Neuron 1.15.0 is the first release to support TensorFlow 2. In this release TensorFlow 2 supports language transformer base models like BERT. The TensorFlow 2 support will be enhanced in future releases to support additional models.
TensorFlow 2.x - To get started with TensorFlow 2.x:
Run the TensorFlow 2 HuggingFace distilBERT Tutorial.
Read TensorFlow 2.x FAQ
See newly introduced TensorFlow-Neuron 2.x Tracing API.
Documentation
New Inferentia Model Architecture Fit application note added in this release. This application note describes what types of deep learning model architectures perform well out of the box and provides guidance on techniques you can use to optimize your deep learning models for Inferentia.
New Neuron inference performance page provides performance information for popular models and links to test these models in your own environment. The data includes throughout and latency numbers, cost per inference, for both realtime and offline applications.
New Bring your own HuggingFace pretrained BERT container to Sagemaker Tutorial.
More information
Detailed release notes¶
Software |
Details |
|---|---|
General |
|
PyTorch |
|
TensorFlow |
|
Apache MXNet (Incubating) |
|
Compiler |
|
Runtime |
|
Tools |
|
DLAMI and Conda Packages |
|
Software Deprecation |