This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Developer Guides#

These guides explain how Neuron Agentic Development skills work internally. Read them to understand the architecture, decision logic, and validation strategies that the agents use under the hood.

Deep dive: Port HuggingFace models to Neuron with the Autoport skill

How the Autoport skill analyzes model architectures, generates NxD Inference implementations, compiles to NEFF, and validates accuracy against the original model.

Deep dive: Port GPU-compatible models to the vLLM Neuron backend with the Autoport skill

How the Autoport vLLM Neuron skill researches model architectures, generates vLLM Neuron implementations for the Trainium2 backend, registers them, and validates logits and equivalence against the GPU-compatible reference implementation.

Deep dive: Validate model ports with the Equivalence skill

How the Equivalence skill compares numerical output between a reference model and its port. Covers both NxD Inference and vLLM Neuron targets.

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3