This document is relevant for: Inf1, Inf2, Trn1, Trn2

Announcing end of support XLA_USE_BF16 and XLA_DOWNCAST_BF16 environment variables starting next release#

Neuron Release 2.24 will be the last release to support the following environment variables:

  • XLA_USE_BF16

  • XLA_DOWNCAST_BF16

I currently utilize these environment variables in my model code. What do I do?

Customers are recommended to migrate to automatic mixed-precision or use model.to(torch.bfloat16) command to convert their model to BF16 format. For detailed migration guidance, please refer to Migration From XLA_USE_BF16/XLA_DOWNCAST_BF16.

This document is relevant for: Inf1, Inf2, Trn1, Trn2