-
Notifications
You must be signed in to change notification settings - Fork 408
Insights: embeddings-benchmark/mteb
Overview
Could not load contribution data
Please try again later
4 Releases published by 1 person
21 Pull requests merged by 7 people
-
Added Crema_d Dataset
#2651 merged
Jun 3, 2025 -
ci: Delete cache in Model loading test only when model is loaded
#2761 merged
Jun 3, 2025 -
Added AmbientAcousticContext Dataset
#2642 merged
Jun 3, 2025 -
Added GTZAN Clustering Dataset
#2653 merged
Jun 3, 2025 -
MAEB: M-CTC-T Model
#2753 merged
Jun 3, 2025 -
Added TutAcoustic Scenes Dataset
#2647 merged
Jun 3, 2025 -
[MAEB] CNN14 Model (PANNs)
#2757 merged
Jun 2, 2025 -
Add missing PatchCamelyon_labels.txt
#2756 merged
Jun 2, 2025 -
MAEB: Seamlessm4t Model (V2)
#2751 merged
Jun 2, 2025 -
MAEB: MMS Models
#2750 merged
Jun 2, 2025 -
MAEB: Encodec Model
#2754 merged
Jun 2, 2025 -
fix: Update caltech101
#2759 merged
Jun 2, 2025 -
fix: Specify dependencies for nomic models and ensure that they can load
#2748 merged
Jun 2, 2025 -
docs: Added documentation for push_to_hub
#2747 merged
Jun 2, 2025 -
Update Seed1.5 training data
#2749 merged
Jun 1, 2025 -
Backfill task metadata for metadata for BigPatentClustering and AllegroReviews
#2755 merged
Jun 1, 2025 -
docs: Updated description of FEVER
#2745 merged
May 31, 2025 -
fix: Correct embedding dimension for bge-m3
#2738 merged
May 29, 2025 -
fix: Add colpali models family
#2721 merged
May 27, 2025 -
fix: Rename display name of VDR
#2734 merged
May 27, 2025 -
Add ViDoRe combined benchmark and add to leaderboard side panel
#2732 merged
May 27, 2025
9 Pull requests opened by 8 people
-
Add miracl vision
#2736 opened
May 28, 2025 -
fix: raise error when model not found
#2737 opened
May 29, 2025 -
Add R2MED Benchmark
#2740 opened
May 30, 2025 -
add xyz model
#2741 opened
May 30, 2025 -
add ListConRanker model
#2742 opened
May 30, 2025 -
Audio Reranking Abstask+ Evaluator + Mini/Dummy AudioCaps Subset
#2744 opened
May 31, 2025 -
Adding BirdSet Bioacoustics dataset
#2752 opened
Jun 1, 2025 -
Merge branch 'main' into v2.0.0
#2760 opened
Jun 2, 2025 -
Add IFIR relevant tasks.
#2763 opened
Jun 3, 2025
6 Issues closed by 4 people
-
Added CREMA-D dataset for emotions clustering
#2208 closed
Jun 3, 2025 -
Add readme to all MTEB datasets
#1892 closed
May 31, 2025 -
[v2] Map task subtypes with available on huggingface `task_ids` when generating DatasetCard
#2624 closed
May 29, 2025 -
Embedding Dimension Mismatch for bge-m3
#2735 closed
May 29, 2025 -
Sort does not work on the leaderboard
#2733 closed
May 27, 2025 -
Add Visual Document Retrieval tab in leaderboard
#2723 closed
May 27, 2025
2 Issues opened by 2 people
-
Missing Results for LENS on MTEB-en-v2
#2762 opened
Jun 2, 2025 -
mteb/msmarco-v2 inconsistency with the original dataset
#2746 opened
May 31, 2025
21 Unresolved conversations
Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.
-
Added VoxPopuli Datasets
#2648 commented on
Jun 3, 2025 • 10 new comments -
[v2] Integrate cde models
#2076 commented on
Jun 2, 2025 • 5 new comments -
Added VoxCeleb Clustering Dataset
#2654 commented on
Jun 3, 2025 • 3 new comments -
fix: Add `cadet-embed-base-v1`
#2727 commented on
Jun 2, 2025 • 1 new comment -
Add AESDD dataset
#2437 commented on
Jun 3, 2025 • 1 new comment -
Add IEMOCAP dataset
#2380 commented on
Jun 3, 2025 • 1 new comment -
Add support for FinMTEB benchmark
#1379 commented on
Jun 2, 2025 • 0 new comments -
BREAKING: v2.0.0
#1433 commented on
Jun 2, 2025 • 0 new comments -
Add Gene-MTEB tasks
#1959 commented on
Jun 2, 2025 • 0 new comments -
fix: Leaderboard integration test
#2042 commented on
Jun 2, 2025 • 0 new comments -
MAEB Overview Issue
#2072 commented on
Jun 3, 2025 • 0 new comments -
MTEB Arabic Benchmark
#2135 commented on
Jun 2, 2025 • 0 new comments -
Adds SpokeN-100-English
#2342 commented on
Jun 1, 2025 • 0 new comments -
Unable to sort leaderboard
#2662 commented on
Jun 2, 2025 • 0 new comments -
Backfill task metadata for HISTORIC DATASETS
#2502 commented on
Jun 1, 2025 • 0 new comments -
Added 5 datasets for audio pair classification
#2463 commented on
Jun 3, 2025 • 0 new comments -
add xet support
#2603 commented on
Jun 2, 2025 • 0 new comments -
Added Birdclef Subset Dataset
#2641 commented on
Jun 3, 2025 • 0 new comments -
Failed Image benchmark
#2715 commented on
May 29, 2025 • 0 new comments -
Investigate performance discrepancies in gte-Qwen and NV-embed models
#1600 commented on
May 27, 2025 • 0 new comments -
Integrate `Highlighting What Matters`
#2731 commented on
May 27, 2025 • 0 new comments