This document is relevant for: Trn2, Trn3
Accuracy#
Design documentation for the accuracy debugging tools — how they are built internally. Read these only if you want to understand, extend, or contribute to the tool implementations.
To use the accuracy tools, see:
Debugging accuracy issues — methodology
Accuracy debugger tools — how to run them
Accuracy examples — simplified examples for accuracy tools
How the tools are built:
Topic |
What it explains |
|---|---|
Accuracy debugger design and report explanation |
|
How task-level lm_eval dataset runners work |
|
How teacher-forced logit comparison works |
|
How KV cache extraction and comparison works |
|
How intermediate tensors are captured from compiled graphs |
|
Two-way and three-way tensor comparison algorithms |
|
How tensors can be injected into compiled graphs for isolation |
|
How NRT-boundary input tensors are captured for off-chip replay |
|
Writing per-module accuracy tests with appropriate thresholds |
This document is relevant for: Trn2, Trn3