This document is relevant for: Inf1, Trn1

Neuron K8 Release Notes#

Introduction#

This document lists the current release notes for AWS Neuron Kubernetes (k8) components. Neuron K8 components include a device plugin and a scheduler extension to assist with deployment and management of inf1 nodes within Kubernetes clusters. Both components are offered as pre-built containers in Public ECR and ready for deployment.

  • Device Plugin: public.ecr.aws/neuron/neuron-device-plugin:2.0.0.0

  • Neuron Scheduler: public.ecr.aws/neuron/neuron-scheduler:2.0.0.0

It’s recommended to pin the version of the components used and to never use the “latest” tag. To get the list of image tags, please refer to these notes or check the image tags on the repo directly.

To Pull the Images from ECR:

docker pull  public.ecr.aws/neuron/neuron-device-plugin:2.0.0.0
docker pull  public.ecr.aws/neuron/neuron-scheduler:2.0.0.0

Neuron K8 release [2.1.0.0]#

Date: 10/27/2022

Summary#

  • Added support for NeuronCore based scheduling to the Neuron Kubernetes Scheduler. Learn more about how to use NeuronCores for finer grain control over container scheduling by following the K8 tutorials documentation in the containers section.

Neuron K8 release [2.0.0.0]#

Date: 10/10/2022

Summary#

  • Added support for TRN1 and INF1 EC2 instance types.

Neuron K8 release [1.9.3.0]#

Date: 08/02/2022

Summary#

  • Minor updates.

Neuron K8 release [1.9.2.0]#

Date: 05/27/2022

Summary#

  • Minor updates.

Neuron K8 release [1.9.0.0]#

Date: 04/29/2022

Summary#

  • Minor updates.

Neuron K8 release [1.8.2.0]#

Date: 03/25/2022

Summary#

  • Minor updates.

Neuron K8 release [1.7.7.0]#

Date: 01/20/2022

Summary#

Minor updates

Neuron K8 release [1.7.3.0]#

Date: 10/27/2021

Summary#

Minor updates

[1.6.22.0]#

Date: 08/30/2021

Summary#

Minor updates.

[1.6.15.0]#

Date: 08/06/2021

Summary#

Minor updates.

[1.6.7.0]#

Date: 07/26/2021

Summary#

Minor internal enhancements.

[1.6.0.0]#

Date: 07/02/2021

Summary#

Minor internal enhancements.

[1.5.3.0]#

Date: 05/01/2021

Summary#

Minor internal enhancements.

[1.4.1.0]#

Date: 01/30/2021

Summary#

Minor internal enhancements.

[1.3.2.0]#

Date: 12/23/2020

Summary#

Minor internal enhancements.

[1.2.0.0]#

Date: 11/17/2020

Summary#

Minor internal enhancements.

[1.1.23.0]#

Date: 10/22/2020

Summary#

Support added for use with Neuron Runtime 1.1. More details in the Neuron Runtime release notes at neuron-runtime-release-notes.

[1.1.17.0]#

Date: 09/22/2020

Summary#

Minor internal enhancements.

[1.0.11000.0]#

Date: 08/08/2020

Summary#

First release of the Neuron K8 Scheduler extension.

Major New Features#

  • New scheduler extension is provided to ensure that kubelet is scheduling pods on inf1 with contiguous device ids. Additional details about the new scheduler are provided neuron-k8-scheduler-ext. including instructions on how to apply it.

    • NOTE: The scheduler is only required when using inf1.6xlarge and/or inf1.24xlarge

  • With this release the device plugin now requires RBAC permission changes to get/patch NODE/POD objects. Please apply the k8s-neuron-device-plugin-rbac.yml before using the new device plugin.

Resolved Issues#

This document is relevant for: Inf1, Trn1