This document is relevant for: Inf2, Trn1, Trn2, Trn3

NCC_EVRF050#

Error message: ScaledMatmul custom call contracting dimension sizes mismatch.

The __op$block_scaled_dot custom call performs matrix multiplication on MXFP8-quantized tensors. The compiler compares the first configured LHS and RHS contracting dimensions and raises this error when their sizes differ. If a contracting dimension is omitted, the compiler uses the last dimension.

To fix this error, ensure the LHS and RHS contracting dimension sizes match.

This document is relevant for: Inf2, Trn1, Trn2, Trn3