Unverified50% confidenceFactExact time
Online evaluation runs automatically on real traffic, can be triggered at the span level or trace level, and controls cost by sampling at a rate of 1%-10%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/19/2026
First Seen
Valid until: 1/17/2027
Sources
Related Entities
Related Claims
UnverifiedOnline evaluation reflects user experience under the real distribution, and corresponds to offline evaluation run on test sets.71% similarUnverifiedThe production-stage evaluation shifts to sampled evaluation of online traffic, combined with user feedback signals, to continuously capture quality changes caused by model or data drift, rather than being a one-time gate.70% similarUnverifiedEvaluation can be divided into online evaluation (real-time monitoring in a production environment) and offline evaluation (batch testing on a fixed test set), with the latter being the foundation for rapid iteration.68% similarUnverifiedIn order to test model performance in real-world scenarios, the evaluation process often requires the model to access the live internet, for example to retrieve information, call online APIs, or execute multi-step web operations.66% similarUnverifiedThe system evaluates in real time the potential value of each additional search step, executing it only when the expected benefit exceeds the cost.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1072727API
curl https://kongchang.com/api/v1/knowledge/claims/1072727MCP
get_claim(id=1072727)