Unverified50% confidenceFactExact time
Human annotation was completed by two groups of three fluent English speakers each, with Fleiss' Kappa values of 0.65 and 0.57 respectively for the two groups, showing no significant difference.
1
Sources
50%
Confidence
Long-term
Relevance
10/5/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedEven experienced human experts performing the same review task often achieve inter-group Kappa values of only 0.4–0.6.69% similarUnverifiedThe audit results show that automatic labels agree with human consensus on 90.3% of claims, with a Cohen's Kappa coefficient of 0.87.68% similarUnverifiedA study published in Nature in 2020 found that Cohen's Kappa coefficient for different reviewers' scores on the same paper is typically less than 0.3.64% similarUnverifiedCohen's Kappa coefficient is suitable for scenarios with two reviewers and categorical variables; its value ranges from -1 to 1, and a value above 0.6 is generally considered moderate agreement, while above 0.8 is considered high agreement.62% similarUnverifiedThe standard interpretation of Cohen's Kappa is typically: κ < 0.20 slight, 0.21–0.40 fair, 0.41–0.60 moderate, 0.61–0.80 substantial, and above 0.80 almost perfect.56% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/977918API
curl https://kongchang.com/api/v1/knowledge/claims/977918MCP
get_claim(id=977918)