Monitor OpenAI APIs

AppDynamics Python Agent helps you monitor the OpenAI API usage and related metrics. It monitors the ChatCompletion, Completion, and Moderation APIs type requests created using the openai-python library to the OpenAI backend. The agent also captures the prompts and responses used by the OpenAI API models.

The following metrics are reported at the application, tier, and node levels:

  • Calls per minute
  • Errors per minute
  • Tokens

The following are the example metric paths:

Per model metric path
Application Infrastructure Performance|OpenAI_Tier|OpenAI|ada|Tokens
All model cumulative metrics path
Application Infrastructure Performance|OpenAI_Tier|OpenAI|Tokens - All Models
Net application level metrics path
Overall Application Summary|OpenAI - Tokens - ada
Note: These metrics are reported even if the exit call is outside the business transaction. However, the Average Response Time(ms) metric is not reported when the exit call is outside the business transaction.