Here is more details about evaluate API
user
, assistant
, or both
, optionally you can pass the system
message.policies
parameter.correction_enabled
is set to true
, the LLM will be corrected by an automatic correction, or a manual override response defined in the policy.fail_fast
is set to true
, it will stop the evaluation once any policy is violated.policy_ids
in API request, it will be checked on every evaluation request against the provided messages (user
, assistant
, or both). The policies have a priority order, first in the list has the highest priority. If
fail_fastis set to
true`, it will stop the evaluation once any policy is violated.
Here is the policy flow: