Add FaMTEB (Farsi/Persian Text Embedding Benchmark)#1843

Open

mehran-sarmadi wants to merge 18 commits intoembeddings-benchmark:mainfrom mehran-sarmadi:fa-mteb-v1

+2,613

Commits on Jan 24, 2025

Add Summary Retrieval Task
mehran
committed
Add FaMTEBClassification
mehran
committed
Add FaMTEBClustering
mehran
committed
Add FaMTEBPairClassification
mehran
committed
Add FaMTEBRetrieval and BEIRFA and FaMTEBSTS
mehran
committed
Add FaMTEBSummaryRetrieval
mehran
committed
Add FaMTEB to benchmarks
mehran
committed
fix benchmark names
mehran
committed
temporary fix metadata
mehran
committed
Fix dataset revisions
mehran
committed

Commits on Jan 25, 2025

Fix conflict

mehran-sarmadi
authored and
mehran
committed
Update SummaryRetrievalEvaluator.py
mehran
committed
Update task files
mehran
committed
Update task files
mehran
committed

Commits on Jan 26, 2025