Non-Refusal Rate
A metric in safety evaluation, defined as the proportion of model responses that do not explicitly refuse, combining non-refusal categories such as compliance and evasion. It is less sensitive to scorer misjudgments between adjacent classes but is coarser in granularity.
Timeline (last 90 days)
After excluding the three collapsed scorers, the compliance rates on the four remaining corpora still differ by 1.7 to 2.8 times, and the non-refusal rates differ by 10 to 22 percentage points.
Cross-grader differences in compliance rates manifest as multiplicative (ratios can reach tens of times), whereas differences in non-refusal rates manifest as additive (percentage-point differences), so non-refusal rate is more robust to grader disagreement but coarser-grained.
All Facts (2)
After excluding the three collapsed scorers, the compliance rates on the four remaining corpora still differ by 1.7 to 2.8 times, and the non-refusal rates differ by 10 to 22 percentage points.
50%UnverifiedCross-grader differences in compliance rates manifest as multiplicative (ratios can reach tens of times), whereas differences in non-refusal rates manifest as additive (percentage-point differences), so non-refusal rate is more robust to grader disagreement but coarser-grained.
50%