Unverified50% confidenceFactExact time
MMoE (Multi-gate Mixture-of-Experts) was proposed by Google in 2018, and its core is placing multiple expert sub-networks in the shared layer, with each task having an independent gating network that weights and combines the expert outputs.
1
Sources
50%
Confidence
Long-term
Relevance
10/22/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedThe Mixture of Experts (MoE) architecture was scaled up within the Transformer framework by Google Brain in 2017; its core idea is to group model parameters into multiple expert sub-networks, with only a small subset activated during each inference.69% similarUnverifiedThe MoE (Mixture of Experts) architecture was first proposed by Hinton's team in 2017, dynamically selecting Top-K expert sub-networks to participate in computation through a gated routing network.66% similarUnverifiedGoogle's Agent2Agent (A2A) protocol and Microsoft's AutoGen framework are both driving the direction of multi-agent collaboration.64% similarUnverifiedGoogle's AI capabilities are dispersed across Google Research, Google DeepMind, and multiple product lines including Search, Assistant, and Cloud, and flagship model releases require coordination among safety teams, policy compliance teams, and integration requirements across business lines.64% similarUnverifiedThe MoE architecture divides the model into multiple expert sub-networks, activating only a small portion during each inference, reducing computational costs while maintaining knowledge capacity; Google's Gemini and Mistral's Mixtral series both adopt this architecture.64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1086400API
curl https://kongchang.com/api/v1/knowledge/claims/1086400MCP
get_claim(id=1086400)