This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Developer Tools#

AWS Neuron provides a comprehensive suite of developer tools for optimizing, monitoring, and debugging machine learning workloads on AWS Inferentia and Trainium accelerators. These tools enable developers to gain deep insights into model performance, system utilization, and hardware behavior to maximize the efficiency of ML applications running on Neuron-enabled instances.

Neuron Agentic Development

AI agents and skills for developing on Trainium and Inferentia. Write NKI kernels, debug compilation errors, profile performance, and port HuggingFace models to NxD Inference using natural language.

Neuron Explorer

Neuron Explorer is a suite of tools designed to support ML engineers throughout their development journey on AWS Trainium, from model development through debugging, profiling, analysis, and optimization.

System Tools

Command-line utilities for monitoring, debugging, and managing AWS Neuron devices, including neuron-monitor, neuron-top, neuron-ls, and more.

Third Party Tools

Third-party tools and integrations that support the AWS Neuron development experience, including monitoring, visualization, and optimization solutions.

Tutorials

Tutorials for how to utilize all Neuron Tools.

Release Notes

Latest updates, new features, and improvements to Neuron Tools and Neuron Explorer.

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3