This document is relevant for: Inf1, Inf2, Trn1, Trn2

Self Managed Kubernetes Service

Introduction

Use of Neuron in containers on a Kubernetes cluster can be simple to achieve by following EKS Setup For Neuron

Known Limitations

Scheduling on k8s cluster requires contiguous neuron device-ids. Neuron provides a scheduler extension to solve this problem for self-managed k8 clusters. Read more about it here: neuron-k8-scheduler-ext.

This document is relevant for: Inf1, Inf2, Trn1, Trn2