This document is relevant for: Inf2, Trn1, Trn2, Trn3

NCC_EVRF040

Error message: QuantizeMX custom call scale_method is unsupported.

The QuantizeMX custom call implements OCP MXFP-8 microscaling quantization (https://www.opencompute.org/documents/ocp-microscaling-formats-mx-v1-0-spec-final-pdf). Currently, only the "EMAX" scale computation method is supported. The compiler raises this error when a different scale_method value is provided in backend_config.

To fix this error, use "scale_method": "EMAX".

This document is relevant for: Inf2, Trn1, Trn2, Trn3