Mensure and detect uncertainty in AI-generated content
metric.uncertainty
rule, a semantic entropy based metric that generate different responses for the same input, and compute the entropy of the responses.
metric.uncertainty
fail
(to flag when the uncertainty is high)system prompt
is provided, and the model
, and other relevant model parameters
is set up on application level.