This document is relevant for: Inf2, Trn1, Trn2, Trn3
NCC_EVRF050#
Error message: ScaledMatmul custom call contracting dimension sizes mismatch.
The __op$block_scaled_dot custom call performs matrix multiplication on
MXFP8-quantized tensors. The compiler compares the first configured LHS and RHS
contracting dimensions and raises this error when their sizes differ. If a
contracting dimension is omitted, the compiler uses the last dimension.
To fix this error, ensure the LHS and RHS contracting dimension sizes match.
This document is relevant for: Inf2, Trn1, Trn2, Trn3