Unverified50% confidenceOpinionExact time
The video points out that 'the sieve itself also leaks': if the tests are written loosely, bad things can also pass; all tests passing only means it passed the tests you wrote, not that it is actually correct.
1
Sources
50%
Confidence
Long-term
Relevance
10/20/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedRejection tests should be written before positive tests, because positive tests pass on day one, and the scenarios that truly expose problems are those where there is no data yet an answer is forced.72% similarUnverifiedIf the acceptance test is "looks fine," the accepted field becomes a constant, the attempt-count metric loses meaning, and the ledger should be skipped entirely.68% similarUnverifiedTabibu's testing is based only on spot checks of a small number of fictitious documents and has not yet undergone a complete evaluation, so no accuracy figures are published; at the policy level there is still no clinician review, and Swahili answers have only undergone AI review; the WhatsApp document reading feature is still in testing and not fully open; and the end-to-end cost per file has not yet been measured.63% similarUnverifiedMost benchmarks use accuracy as the core metric, counting both wrong answers and refusals as incorrect and not distinguishing the difference in harm.61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1077700API
curl https://kongchang.com/api/v1/knowledge/claims/1077700MCP
get_claim(id=1077700)