Skip to content

Pull requests: embeddings-benchmark/mteb

New pull request New
32 Open 2,958 Closed
32 Open 2,958 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add CO₂ estimate per million tokens from active parameters
#4878 opened Jul 2, 2026 by fzowl Contributor Loading…
1
1
Add openness score to model metadata and documentation
#4877 opened Jul 2, 2026 by fzowl Contributor Loading…
1
dataset: add cleaned STSBenchmark v2
#4876 opened Jul 2, 2026 by wgu9 Contributor Loading…
1
feat: auto-install optional model dependencies via MTEB_AUTO_INSTALL_EXTRAS
#4875 opened Jul 2, 2026 by fzowl Contributor Loading…
1
fix: reconstruct main_score for legacy reranking and pair-classification results
#4874 opened Jul 1, 2026 by fzowl Contributor Loading…
1
Cap Seq Length for Some Models
#4873 opened Jul 1, 2026 by AdnanElAssadi56 Contributor Loading…
1
Expand MTEB(kor, v1) with retrieval/STS/NLI/clustering tasks + register 9 Korean models
#4870 opened Jul 1, 2026 by daegonYu Contributor Loading…
8
agentic: add answer-mode retrieval core (contract, evaluator, baselines)
#4869 opened Jun 30, 2026 by AdnanElAssadi56 Contributor Loading…
Add structure-aware corpus-adaptive hybrid retriever
#4867 opened Jun 30, 2026 by thu-nmrc Loading…
5
model: Add VoiceNet voiceclap-large and voiceclap-small
#4864 opened Jun 29, 2026 by fzowl Contributor Loading…
1
feat: add retrieval keyword-overlap descriptive stats
#4860 opened Jun 28, 2026 by wgu9 Contributor Loading…
1
9
Add model: google/gemini-embedding-2 (GA)
#4859 opened Jun 27, 2026 by fzoll Contributor Loading…
1
1
perf(leaderboard): lazy load benchmark plots leaderboard issues related to the leaderboard
#4855 opened Jun 24, 2026 by SmileLikeYe Collaborator Loading…
3
Fix empty leaderboard task info leaderboard issues related to the leaderboard
#4854 opened Jun 24, 2026 by SmileLikeYe Collaborator Loading…
fix: guard leaderboard benchmark query leaderboard issues related to the leaderboard
#4853 opened Jun 24, 2026 by SmileLikeYe Collaborator Loading…
Add overview benchmark
#4852 opened Jun 24, 2026 by ayush1298 Collaborator • Draft
1
2
fix: drop duplicate train documents in SyntheticText2SQL corpus
#4846 opened Jun 22, 2026 by fzowl Contributor Loading…
1
1
fix por benchmark
#4844 opened Jun 21, 2026 by Samoed Member Loading…
2
Wave 7b integration new model Questions related to adding a new model to the benchmark
#4841 opened Jun 20, 2026 by debashishc • Draft
1
13
dataset: Added NANOBEIR Extended Benchmark new benchmark Issues related to adding a new benchmark
#4837 opened Jun 19, 2026 by ayush1298 Collaborator Loading…
43
model: Add LFM2.5 and LFM2 models new model Questions related to adding a new model to the benchmark
#4835 opened Jun 19, 2026 by ayush1298 Collaborator Loading…
6 of 7 tasks
1
22
feat: add OpenAIEndpointWrapper for HTTP-based vLLM servers
#4834 opened Jun 18, 2026 by maryamtahhan Loading…
28
model: Add SPLADE-Code sparse retrieval models (naver/splade-code-06B, splade-code-8B)
#4828 opened Jun 18, 2026 by fzowl Contributor Loading…
1
4
fix: Add MockTask for testing new model implementations
#4814 opened Jun 15, 2026 by ayush1298 Collaborator Loading…
1
120
Add perplexity-ai/pplx-embed-v1-late-0.6b model meta new model Questions related to adding a new model to the benchmark
#4813 opened Jun 14, 2026 by wgu9 Contributor Loading…
1
4
ProTip! Exclude everything labeled bug with -label:bug.