Exact Match
A strict evaluation metric commonly used in question answering and information extraction tasks, in which a model output counts as correct only when it is fully identical to the reference answer after normalization.
Timeline (last 90 days)
After removing the memory profile, exact match drops by 24.7 points, and the recalibrated BERTScore falls from 0.57 to 0.35.
Exact match is a strict lower bound that underestimates the actual usable prompt quality; graded metrics and LlamaPIE's built-in judge correlate more highly with human ratings than exact match.
Adding a retrieval module or switching to a larger generator brought no gain in exact match.
The system's knowledge base retrieval adopts a hybrid scheme of vector retrieval plus exact matching, first computing semantic similarity and then performing secondary ranking by urgency and knowledge freshness.
Of the 31 test paraphrases, AILegal's exact-match stage resolved 12; the soft-match stage then added suggestions for another 14, of which 8 were correct, for a precision of about 57%.
There are two approaches to trajectory matching: exact matching suits scenarios with fixed flows, while subsequence matching is looser and only requires key steps to appear in order.
Exact matching is fast but prone to missing cases where the same person uses different contact information, while fuzzy matching has broader coverage but higher computational cost.
All Facts (7)
After removing the memory profile, exact match drops by 24.7 points, and the recalibrated BERTScore falls from 0.57 to 0.35.
50%UnverifiedExact match is a strict lower bound that underestimates the actual usable prompt quality; graded metrics and LlamaPIE's built-in judge correlate more highly with human ratings than exact match.
50%UnverifiedAdding a retrieval module or switching to a larger generator brought no gain in exact match.
50%UnverifiedThe system's knowledge base retrieval adopts a hybrid scheme of vector retrieval plus exact matching, first computing semantic similarity and then performing secondary ranking by urgency and knowledge freshness.
50%UnverifiedOf the 31 test paraphrases, AILegal's exact-match stage resolved 12; the soft-match stage then added suggestions for another 14, of which 8 were correct, for a precision of about 57%.
50%UnverifiedThere are two approaches to trajectory matching: exact matching suits scenarios with fixed flows, while subsequence matching is looser and only requires key steps to appear in order.
50%UnverifiedExact matching is fast but prone to missing cases where the same person uses different contact information, while fuzzy matching has broader coverage but higher computational cost.
50%