AWS Bedrock API のモニタリング

Splunk AppDynamics Python エージェントは、OpenAI API の使用状況と関連メトリックをモニターするのに役立ちます。Boto3 ライブラリを使用して作成された converse および converse_stream 要求をモニターします。

次のメトリックは、アプリケーション、階層、およびノードの各レベルで報告されます。

入力トークン = 0.5$
完了トークン = 1.5$
トークン
遅延
1分あたりのコール数

Prerequisites

Python agent supports the Boto3 for AWS Bedrock in Splunk AppDynamics. For more information, see Boto3 documentation.

Ensure that you meet the following prerequisites to monitor the OpenAI API exit calls with AppDynamics:

Install Python Agent 23.8.0 or later. See Install Python Agent.
Import custom dashboards and templates.
Set the enable-bedrock flag to true in the appd.cfg file of the Python Agent.

Create Custom Dashboard

Download Custom_dashboard_script.zip. It contains:


Directory	Description
`templates`	Contains `json` templates to create the dashboard files.
`dashboard`	Dashboard `json` files are created here. It contains the sample `json` files.
`main.py`	Python script to create the dashboards.
`readme.md`	Description of the solution.

Run the following command:
```
cd Custom_dashboard_script
python3 main.py
```
The preceding command prompts you to specify the dashboard type (application or tier) that you want to create.

Based on your selected dashboard type, you will be prompted to specify the following dashboard details.

Application Level Dashboard Detals


Variable	Description	Default	Possible Values	Required
Dashboard Name	Dashboard Title that is displayed in Dashboard and Reports.	`bedrock_app_dashboard`	`bedrock_app_dashboard`	Optional
Application Name	Name of the Application with bedrock backend calls.	`bedrock_app`	None	Yes

Model Level Dashboard Details


Variable	Description	Default	Possible Values	Required
Model Name	Name of the Model which you want to monitor.	`amazon-titan-dashbaord`	None	Yes
Dashboard Name	Dashboard Title that is displayed in Dashboard and Reports.	`bedrock_app_dashboard`	`bedrock_app_dashboard`	Optional
Application Name	Name of the Application with bedrock backend calls.	`bedrock_app`	None	Yes

注: If Model Name has special characters, you must replace them with hyphens ( - ). For example, if the model name is "amazon-titan-lite:1", change the name to "amazon-titan-lite-1".

Import the dashboard in the Controller UI. See Create and Manage Custom Dashboards and Templates

ヒント: Navigate to Tiers & Nodes > My Dashboards and create a dashboard for the selected application by copying and pasting widgets from the existing dashboard for easier navigation.