1.34.10

1.34.10 (2025-02-12)

Documentation

• docs: Fix README code rendering (#2037)

Fix README code rendering (1b04130)

Fix

• fix: Add versioning to MTEB benchmarks (#2024)

• Add versioning to MTEB benchmarks

• Following suggestion made in #2001 I added version to MTEB benchmarks
• changed the name of the MTEB(Chinese) to MTEB(cmn, v1). Though we could go for MTEB(Chinese, v1) assuming it is a group (also covering chinese other than mandarin)
• change the name of FaMTEB(fas, beta) to MTEB(fas)
• did a minor formatting of imports due to a circular import error
• moved the Benchmark object out of the file with the benchmarks
  • this is still >1000 lines so we could split it up to "external_benchmarks", "monolingual_benchmarks", "domain_specific_benchmarks", "multilingual_benchmarks"

Fixes #2001

• format

• update tests

• updated for backward compatibility

• ibid

• Update mteb/benchmarks/get_benchmark.py

Co-authored-by: Roman Solomatin <[email protected]>

• Update mteb/benchmarks/get_benchmark.py

Co-authored-by: Roman Solomatin <[email protected]>

• add missing import

---

Co-authored-by: Roman Solomatin <[email protected]> (65f3407)