Conceptsurrogate annotation test
Substitute Annotation Test
A methodological framework for verifying whether an automated annotation system can replace human annotators. It compares the agreement between human and model annotations on the same set of samples using the Kappa coefficient to evaluate the reliability of model-generated annotations.
Timeline (last 90 days)
Oct 5
Existing surrogate annotation tests typically measure the agreement between model and human annotations only under a single fixed condition.
Unverified50%