GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • embeddings-benchmark
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles

This view

  • Original page
  • New address

GeezerVison is showing github.com β€” Massive Text Embedding Benchmark

README.md

MTEB is a Python framework for evaluating embeddings and retrieval systems for both text and image. MTEB covers more than 1000 languages and diverse tasks, from classics like classification and clustering to use-case specialized tasks such as legal, code, or healthcare retrieval.

You can get started using mteb.

Overview
πŸ“ˆ Leaderboard The interactive leaderboard of the benchmark
Get Started.
πŸƒ Get Started Overview of how to use mteb
πŸ€– Defining Models How to use existing model and define custom ones
πŸ“‹ Selecting tasks How to select tasks, benchmarks, splits etc.
🏭 Running Evaluation How to run the evaluations, including cache management, speeding up evaluations etc.
πŸ“Š Loading Results How to load and work with existing model results
Overview.
πŸ“‹ Tasks Overview of available tasks
πŸ“ Benchmarks Overview of available benchmarks
πŸ€– Models Overview of available Models
Contributing
πŸ€– Adding a model How to submit a model to MTEB and to the leaderboard
πŸ‘©β€πŸ’» Adding a dataset How to add a new task/dataset to MTEB
πŸ‘©β€πŸ’» Adding a benchmark How to add a new benchmark to MTEB and to the leaderboard
🀝 Contributing How to contribute to MTEB and set it up for development

Popular repositories Loading

  1. mteb mteb Public

    MTEB: State-of-the-art evaluation of embeddings across languages and modalities

    Python 3.5k 769

  2. results results Public

    Data for the MTEB leaderboard

    Python 67 224

  3. embedders-dilemma embedders-dilemma Public

    Code, datasets, and results for "The Embedder's Dilemma: LLMs Are Better, but at What Cost?" (COLM 2026). MTEB(LLM) benchmarks 10 LLMs and 26 embedding models on 37 tasks with full cost and through…

    Python 41 1

  4. leaderboard leaderboard Public archive

    Code for the MTEB leaderboard

    Python 32 15

  5. arena arena Public

    Code for the MTEB Arena

    Python 25 12

  6. mtebpaper mtebpaper Public

    Resources & scripts for the paper "MTEB: Massive Text Embedding Benchmark"

    Python 19 5

Repositories

Loading
Type
Language
Sort
Showing 10 of 14 repositories
  • mteb Public

    MTEB: State-of-the-art evaluation of embeddings across languages and modalities

    embeddings-benchmark/mteb's past year of commit activity
    Python 3,509 Apache-2.0 769 306 (3 issues need help) 32 Updated Nov 12, 2026
  • results Public

    Data for the MTEB leaderboard

    embeddings-benchmark/results's past year of commit activity
    Python 67 CC0-1.0 224 0 5 Updated Nov 12, 2026
  • MTEB-gym Public

    Offline LLM-judged arena for embedding models

    embeddings-benchmark/MTEB-gym's past year of commit activity
    Python 3 Apache-2.0 4 6 5 Updated Nov 12, 2026
  • gym-paper Public

    Analyses behind the MTEB Gym paper, computed from the published gym-results and mteb/gym-runs

    embeddings-benchmark/gym-paper's past year of commit activity
    HTML 0 0 0 0 Updated Nov 9, 2026
  • some-autopublish Public

    An experimental promotional agent

    embeddings-benchmark/some-autopublish's past year of commit activity
    HTML 1 1 2 4 Updated Nov 9, 2026
  • gym-results Public

    Results of MTEB Gym, the label-free, LLM-judged evaluation of embedding models

    embeddings-benchmark/gym-results's past year of commit activity
    Python 0 CC0-1.0 1 0 0 Updated Nov 8, 2026
  • leaderboard-frontend Public
    embeddings-benchmark/leaderboard-frontend's past year of commit activity
    Svelte 2 Apache-2.0 8 1 4 Updated Oct 24, 2026
  • embedders-dilemma Public

    Code, datasets, and results for "The Embedder's Dilemma: LLMs Are Better, but at What Cost?" (COLM 2026). MTEB(LLM) benchmarks 10 LLMs and 26 embedding models on 37 tasks with full cost and throughput accounting.

    embeddings-benchmark/embedders-dilemma's past year of commit activity
    Python 41 Apache-2.0 1 0 0 Updated Sep 19, 2026
  • .github Public
    embeddings-benchmark/.github's past year of commit activity
    0 0 0 0 Updated Aug 18, 2026
  • autoembed Public
    embeddings-benchmark/autoembed's past year of commit activity
    Python 0 1 1 0 Updated Aug 1, 2026
View all repositories

People

@sivareddyg @guenthermi @MartinBernstorff @hepengfe @nmntz @Samoed @tomaarsen @imadtyx @loicmagne @silky1708 @gowitheflow-1998 @arteemg

Top languages

Python HTML Jupyter Notebook Svelte

Most used topics

benchmark clustering information-retrieval retrieval text-classification
You are visitor 01402503 β€” GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800Γ—600. No cookies required.