Container Management in the AI Toolkit

Version 5.7.0 and higher of the AI Toolkit includes a page for Container Management. You can use this page to manage model-specific containers that run on previously configured external runtimes.

From the AI Toolkit app, navigate to the Connections tab and choose Container Management from the drop-down menu.

The following image shows an example of the Container Management page:

This image shows the AI Toolkit. The page called Container Management is selected and highlighted.

Container Management permissions

To start, stop, view logs, or delete containers you must have the following capabilities from the dsdl_admin role:

  • list_containers

  • control_containers