Container tutorials

Step-by-step tutorials for building and running Neuron containers. These guides cover Docker environment setup, container builds, OCI hook configuration, and framework-specific inference and training examples.

General container tutorials

Docker environment setup

Configure Docker on Amazon Linux 2023 to expose Inferentia and Trainium devices to containers.

Build and run Neuron containers

Build Docker images with Neuron support and run containerized applications on Inf1 and Trn1 instances.

Docker Neuron OCI hook setup

Install and configure the Neuron OCI hook to expose all Neuron devices to containers using an environment variable.

Inference tutorials

Inference container tutorial

Run inference in a Neuron container with a pre-built DLC image.

Deploy ResNet-50 on Kubernetes

Deploy a ResNet-50 inference service on an EKS cluster with Inferentia.

Training tutorials

Training container tutorial

Run training in a Neuron container with a pre-built DLC image on Trainium.

Deploy MLP training on Kubernetes

Deploy an MLP training job on an EKS cluster with Trainium.