This document is relevant for: Inf2, Trn1, Trn2, Trn3

NCC_EBIR023

Error message: MLP kernel intermediate size exceeds the maximum supported value of 4096.

Consider tiling large intermediate tensors in your kernel to stay within the supported limit, or increase tensor parallelism to shard the intermediate dimension across more cores.

This document is relevant for: Inf2, Trn1, Trn2, Trn3