This document is relevant for: Trn2, Trn3
Framework#
Topic |
Description |
|---|---|
Async execution double buffering |
|
Multi-process weight loading from SafeTensors |
|
Model registry and factory pattern |
|
Per-graph neuronx-cc arguments through a model method |
This document is relevant for: Trn2, Trn3