This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3

Developer Tools

AWS Neuron provides a comprehensive suite of developer tools for optimizing, monitoring, and debugging machine learning workloads on AWS Inferentia and Trainium accelerators. These tools enable developers to gain deep insights into model performance, system utilization, and hardware behavior to maximize the efficiency of ML applications running on Neuron-enabled instances.

Neuron Explorer

Neuron Explorer is a suite of tools designed to support ML engineers throughout their development journey on AWS Trainium, from model development through debugging, profiling, analysis, and optimization.

Neuron Profiler 2.0

Neuron Profiler 2.0 offers a user-friendly experience for capturing and analyzing application performance through both high-level system profiles and detailed device-level profiles.

Neuron Profiler

The Neuron Profiler is a tool to profile and analyze performance of a ML model compiled with the Neuron compiler and run on NeuronDevices.

System Tools

Command-line utilities for monitoring, debugging, and managing AWS Neuron devices, including neuron-monitor, neuron-top, neuron-ls, and more.

Third Party Tools

Third-party tools and integrations that support the AWS Neuron development experience, including monitoring, visualization, and optimization solutions.

Tutorials

Tutorials for how to utilize all Neuron Tools.

What’s New

Latest updates, new features, and improvements to Neuron Tools.

This document is relevant for: Inf1, Inf2, Trn1, Trn2, Trn3