MTEB Code
A code subset of the Massive Text Embedding Benchmark (MTEB), used to evaluate the performance of embedding models on code understanding and retrieval tasks.
Core Facts
Timeline (last 90 days)
EmbeddingGemma 2's score on the MTEB Code benchmark improved from 68.76 in the first generation to 78.68, an increase of 9.92 points.
EmbeddingGemma 2 achieves leading results among multimodal embedding models of the same size on benchmarks such as MTEB Code and MAEB, setting a new standard for quality per parameter among models with fewer than one billion parameters.
All Facts (2)
EmbeddingGemma 2's score on the MTEB Code benchmark improved from 68.76 in the first generation to 78.68, an increase of 9.92 points.
75%UnverifiedEmbeddingGemma 2 achieves leading results among multimodal embedding models of the same size on benchmarks such as MTEB Code and MAEB, setting a new standard for quality per parameter among models with fewer than one billion parameters.
50%