Labels

• bug

  Something isn't working
• Decision

  This is a decision, it is not an issue intended to be solved
• documentation

  Improvements or additions to documentation
• enhancement

  New feature or request
• evaluation request

  Request for model evaluation
• good first issue

  Good for newcomers
• help wanted

  Extra attention is needed
• image

  The image extension of MTEB
• leaderboard

  issues related to the leaderboard
• maeb

  Audio extension
• more information needed

  More information is needed before this issue can be resolved
• needs discussion

  This issue is still being discussed. It would be pre-mature to implement it.
• new benchmark

  Issues related to adding a new benchmark
• new dataset

  Issues related to adding a new task or dataset
• new model

  Questions related to adding a new model to the benchmark
• priority::high
• priority::low
• priority::medium
• ready for implementation

  This issue is fully discussed and can be implemented.
• repro

  question and issues related to reproducibility
• reranking
• research project
• results

  Issues on results repo
• stale
• WIP

  Work In Progress
• wontfix

  This will not be worked on