This document is relevant for: Inf1, Inf2, Trn1, Trn2
Neuron Deep Learning Containers#
Overview#
AWS Deep Learning Containers (DLCs) provide a set of Docker images that are pre-installed with deep learning frameworks. The containers are optimized for performance and available in Amazon Elastic Container Registry (Amazon ECR). DLCs make it straightforward to deploy custom ML environments in a containerized manner, while taking advantage of the portability and reproducibility benefits of containers.
AWS Neuron DLCs are a set of Docker images for training and serving models on AWS Trainium and Inferentia instances using AWS Neuron SDK. The sections below list all of the AWS Neuron DLCs, as well as the AWS DLCs that come pre-installed with the Neuron SDK.
Inference Containers#
DLC Name |
DLC Link(s) |
Tutorial(s) |
|---|---|---|
Neuron Inference Containers |
||
Large Model Inference (LMI)/Deep Java Library (DJL) Containers |
||
HuggingFace Inference Containers |
||
Triton Inference Containers |
Training Containers#
DLC Name |
DLC Link(s) |
Tutorial(s) |
|---|---|---|
Neuron Training Containers |
||
HuggingFace Training Containers |
Getting started with Neuron DLC using Docker#
Using containers on AWS services#
Amazon EKS#
Amazon ECS#
Amazon SageMaker#
AWS Batch#
Customizing Neuron Deep Learning Containers#
Deep Learning Containers can be customized to fit your specific project needs. To read more, visit Customize Neuron DLC.
This document is relevant for: Inf1, Inf2, Trn1, Trn2