This document is relevant for: Inf2, Trn1, Trn2

nki.language.tile_size#

class nki.language.tile_size[source]#

Tile size constants.

Attributes

bn_stats_fmax

Maximum free dimension of BN_STATS

gemm_moving_fmax

Maximum free dimension of the moving operand of General Matrix Multiplication on Tensor Engine.

gemm_stationary_fmax

Maximum free dimension of the stationary operand of General Matrix Multiplication on Tensor Engine.

pmax

Maximum partition dimension of a tile.

psum_fmax

Maximum free dimension of a tile on PSUM buffer.

psum_min_align

The minimum byte alignment requirement for PSUM free dimension address.

sbuf_min_align

The minimum byte alignment requirement for SBUF free dimension address.

This document is relevant for: Inf2, Trn1, Trn2