Unverified50% confidenceFactExact time
Grouped-query attention (GQA) was proposed by Ainslie et al. in 2023 and is a compromise between multi-head attention (MHA) and multi-query attention (MQA).
1
Sources
50%
Confidence
Long-term
Relevance
10/19/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedQwen2 was released in mid-2024 and adopted architectural improvements such as Grouped Query Attention (GQA) and sliding window attention.73% similarUnverifiedMulti-Head Latent Attention（MLA）由 DeepSeek-V2 于2024年提出66% similarUnverifiedThe GQA technique was initially proposed by Google Research in 2023 and was subsequently widely adopted by mainstream models such as Llama 2 and Mistral.63% similarUnverifiedLlama 3于2024年发布，参数规格为8B、70B和405B，训练数据量超过15万亿tokens，采用分组查询注意力（GQA）技术62% similarUnverifiedGPTQ was proposed in 2022 and improves INT4 quantization quality through layer-wise second-order information calibration.58% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1069157API
curl https://kongchang.com/api/v1/knowledge/claims/1069157MCP
get_claim(id=1069157)