Using AI tier

AI tier provides the software layer for running supported Splunk AI applications and models in your environment. After you deploy AI tier, configure the supported Splunk AI applications that you want to use.

Note: The features available with AI tier can differ from those available in other Splunk deployment environments.

Use the Splunk AI Toolkit with AI tier

You can configure Splunk AI Toolkit to use your AI tier deployment from the Connections tab in the toolkit. From +Connections select Endpoint and then Splunk AI tier.

You can use supported AI Toolkit capabilities with an AI tier deployment. In AI Toolkit, configure a Splunk AI tier connection with the endpoint for your AI tier deployment. You can then configure supported LLM connections to use AI tier.

AI tier version 1.0.0 supports the ai command with the Gemma and GPT OSS 20B models hosted in AI tier, and the apply CDTSM command with the CDTSM model hosted in AI tier.

Note:

The Agents tab, including the Agent Launchpad feature, is not supported with AI tier version 1.0.0.

For more information, see the following pages:

Use the Cisco Deep Time Series Model with AI tier

You can use the Cisco Deep Time Series Model (CDTSM) through AI Toolkit with an AI tier deployment. Configure AI Toolkit to connect to your AI tier deployment, then use the apply CDTSM command to run the CDTSM model hosted in AI tier.

For information about configuring and using CDTSM, see the CDTSM documentation in the Splunk AI Toolkit manual:

Use BYOLLM with AI tier

Bring Your Own LLM (BYOLLM) lets you use a supported Custom LLM connection configured in the Splunk AI Toolkit for Splunk AI Assistant inference. BYOLLM with AI tier supports Custom LLM connections that use OpenID Connect (OIDC) authentication. Configure the connection in the Splunk AI Toolkit and share it with Splunk AI Assistant.

After the connection is shared, an administrator can select the connection for Splunk AI Assistant inference from the Model Runtime settings in Splunk AI Assistant.

For information about selecting a shared LLM connection in Splunk AI Assistant, see Model Runtime in Splunk AI Assistant.