AWS Workload Orchestration

AWS Neuron integrates seamlessly with various AWS compute and orchestration services to accelerate deep learning workloads. This section provides deployment patterns and best practices for running Neuron-powered applications across different AWS services, from container orchestration to high-performance computing clusters.

Amazon EKS

Deploy Neuron workloads on Kubernetes with Amazon Elastic Kubernetes Service

Amazon ECS

Run containerized Neuron applications using Amazon Elastic Container Service

AWS ParallelCluster

Set up HPC clusters for distributed training and inference workloads

AWS Batch

Execute batch ML jobs with automatic scaling and resource management