This document is relevant for: Trn2, Trn3

Model development

Onboard new model architectures, debug accuracy issues, and develop without hardware. For developers adding or validating models on vLLM Neuron.

Onboard a new model

Implement and register a new architecture with vLLM.

CPU development workflow

Develop and test without Neuron hardware.

NKI CPU simulator

Validate NKI kernel correctness on CPU.

Debugging accuracy issues

Methodology for isolating where accuracy drift is introduced.

This document is relevant for: Trn2, Trn3