Splunk AppDynamics Observability for AI supports:

• Monitoring LLM and Vector database API calls via exit call, metrics and events-based monitoring for the following frameworks:
  • OpenAI
  • LangChain (LLMs and vector stores)
  • AWS Bedrock
• Infrastructure Monitoring via Machine Agent and Cluster Agent:
  • NVIDIA GPU