This document is relevant for: Inf2, Trn1, Trn2, Trn3

NCC_EVRF045

Error message: ScaledMatmul custom call output type is unsupported.

The __op$block_scaled_dot custom call performs matrix multiplication on MXFP8-quantized tensors and dequantizes the result. Only F32 and BF16 output types are supported. The compiler raises this error when the result tensor has a different element type.

To fix this error, declare the result as F32 or BF16.

This document is relevant for: Inf2, Trn1, Trn2, Trn3