.. _dlc-then-ec2-devflow: Deploy Neuron Container on EC2 ============================== .. contents:: Table of Contents :local: :depth: 2 Description ----------- |image| .. |image| image:: /images/dlc-on-ec2-dev-flow.png :width: 500 :alt: Neuron developer flow for DLC on EC2 :align: middle You can use the Neuron version of the `AWS Deep Learning Containers `_ to run inference on inf1 instances. In this developer flow, you provision an EC2 inf1 instance using a Deep Learming AMI (DLAMI), pull the container image with the Neuron version of the desired framework, and run the container as a server for the already compiled model. This developer flow assumes the model has already has been compiled through a :ref:`compilation developer flow ` .. _dlc-then-ec2-setenv: Setup Environment ----------------- 1. Launch an Inf1 Instance .. include:: /general/setup/install-templates/inf1/launch-inf1-ami.rst 2. Once you have your EC2 environment set according to :ref:`tutorial-docker-env-setup`, you can build and run a Neuron container using the :ref:`how-to-build-neuron-container` section above. .. [DLC specific flow, uncomment when DLC available] Follow the `Getting Started with Deep Learning Containers for Inference on EC2 `_ and use the appropriate DLC container. .. note:: **Prior to running the container**, make sure that the Neuron runtime on the instance is turned off, by running the command: .. code:: bash sudo service neuron-rtd stop