This document is relevant for: Trn1, Trn2, Trn3

nki.language.gelu#

nki.language.gelu(x, dtype=None)[source]#

GELU activation, element-wise.

This document is relevant for: Trn1, Trn2, Trn3