Monitor Generative AI Applications through Events

The Python Agent captures and publishes events for Large Language Model (LLM) and Vector Database operations. It helps you to monitor and analyze your generative AI application behavior in the Controller.

When you enable monitoring events of generative AI applications, the Python Agent instruments LLM and vector database calls from the supported frameworks. Then, it publishes the event data to the Events Service and this data is displayed on the Controller. Analyze the generative AI applications behavior using this data and take actions if necessary.

Supported Frameworks

After you enable the Python instrumentation to monitor events data, the Python Agent automatically collects events from the following frameworks:

Framework Flag
AWS Bedrock enable-bedrock
LangChain LLM and VectorStores enable-langchain
OpenAI Client enable-openai

Prerequisites

  • Install the Python Agent 25.10.0 or later.

  • Enable the required frameworks with the agent instrumentation.

    For example, capture OpenAI events, set both enable-openai and enable-genai-events to true.

イベントをモニターする Python エージェントの設定

/path/to/appdynamics.cfg ファイルを更新します。
  1. [services:events] セクションで、enable-genai-events フラグを trueに設定します。
    CODE
    [services:events]
    	enable-genai-events = true
    	event-service-url = https://your-events-api-endpoint.com
    	event-service-account-name = <your_account_name>
    	event-service-access-key = <your_access_key_here>
  2. [instrumentation] セクションで、必要なフレームワークを有効にします。
    コードの例:
    CODE
    [instrumentation]
    	enable-openai = true
    	enable-langchain = true 
    	enable-bedrock = true
  3. (オプション)高度なイベントサービス設定を構成します。
    イベントバッファリング、再試行動作、および接続設定をカスタマイズします。[services:events] を参照してください。