Unverified50% confidenceFactExact time
Cognitive demand assessment is a method for understanding model performance by analyzing the cognitive abilities required by a task, typically decomposing the task into multiple cognitive dimensions and experimentally determining each dimension's contribution to model performance.
1
Sources
50%
Confidence
Long-term
Relevance
10/22/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedEvaluation awareness refers to the phenomenon in which a model infers during reasoning that it may be in a testing, monitoring, or red-teaming evaluation scenario and adjusts its output strategically accordingly.74% similarVerifiedIntelligence level is typically evaluated through a series of task benchmarks, while power consumption can be measured directly.71% similarUnverifiedThe "evaluation" method is essentially unit testing for skills: launching multiple sub-agents, with the main coordinating agent setting the scoring criteria, the sub-agents executing tasks in independent directories, and the directory names deliberately designed so the sub-agents do not realize they are being evaluated.69% similarUnverifiedAn evaluation set (eval set) is a carefully constructed collection of input samples and their corresponding expected outputs or evaluation criteria, used to systematically measure a model's performance on specific tasks.69% similarUnverifiedThe recommended path for building evaluations is: first define core tasks and collect real samples, build an evaluation set and set clear metrics, then integrate evaluations into the iteration process.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1084507API
curl https://kongchang.com/api/v1/knowledge/claims/1084507MCP
get_claim(id=1084507)