Unverified50% confidenceFactExact time
BigBird theoretically proved that sparse attention can be Turing complete.
1
Sources
50%
Confidence
Long-term
Relevance
8/31/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedDilated convolution can exponentially expand the receptive field without increasing the number of parameters.57% similarUnverifiedContext window size does not equal effective context length; exceeding the effective attention range causes a forgetting drift phenomenon.57% similarUnverifiedWhen prompts are too long, large models experience an 'attention explosion' phenomenon, where excessively long inputs cause effective information to be lost.55% similarUnverifiedAn "lost in the middle" effect exists in ultra-long contexts, meaning the model has stronger memory for content at the beginning and end of a sequence while attention to middle passages decreases; this phenomenon was named by Stanford researchers.55% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/828092API
curl https://kongchang.com/api/v1/knowledge/claims/828092MCP
get_claim(id=828092)