This document is relevant for: Trn1, Trn2, Trn3

nki.language.tile_size#

class nki.language.tile_size[source]#

Hardware tile size constants (pmax, psum_fmax, gemm_stationary_fmax, etc.)

Attributes

pmax

Maximum partition dimension of a tile

psum_fmax

Maximum free dimension of a tile on PSUM buffer

gemm_stationary_fmax

Maximum free dimension of the stationary operand of General Matrix Multiplication on Tensor Engine

gemm_moving_fmax

Maximum free dimension of the moving operand of General Matrix Multiplication on Tensor Engine

bn_stats_fmax

Maximum free dimension of BN_STATS

psum_min_align

Minimum byte alignment requirement for PSUM free dimension address

sbuf_min_align

Minimum byte alignment requirement for SBUF free dimension address

total_available_sbuf_size

Usable SBUF size per partition (total minus reserved bytes).

This document is relevant for: Trn1, Trn2, Trn3