OpenAI Moderation API
From version 24.1.0, Java Agent supports OpenAI Moderation API. The moderation API will prompt the users if the queried statement is policy compliant or not. The Java Agent captures the following metrics:
-
Calls to moderations API:
OpenAI|moderations|Calls per minute
-
Flagged category metrics:
OpenAI|moderations|Flagged Calls by category|hate
-
Flagged queries count:
OpenAI|moderations|Flagged queries
-
Total queries count:
OpenAI|moderations|Total queries