Splunk AppDynamics Python Agent helps you to monitor GenAI apps built using the LangChain framework. When you instrument the app with Python Agent, it captures the following:

• Exit calls to vector databases: pgvector and chroma.
• Prompts and responses in the exit call.
• Counts of documents retrieved, similarity search score, and errors in vector databases
• Calls per minute

To monitor LLMs using LangChain, such as Ollama, the Python Agent records these metrics:

• Tokens
• Prompt count
• Embedding queries count