Block harmful content across hate speech, violence, sexual content, and self-harm categories.
Evaluate agent output against content safety categories and deny responses that exceed the moderation threshold. This policy covers the four primary harm categories with a balanced threshold suitable for most user-facing applications.
Categories to evaluate. Also available: harassment, dangerous_content
action
DENY
Action on violation. Options: DENY, MONITOR, REDACT
For internal tools where content risk is lower, raise the threshold to 0.85. For children’s applications or highly regulated environments, lower it to 0.5.