用eval_mteb.py算出来的mteb指标和Leaderboard展示的差距很大，不清楚为什么？

#16

by YangGuang30 - opened 11 days ago

•

只算了中文的retrievel任务MMarcoRetrieval: 0.4945
DuRetrieval: 0.38997

可能是你没有加Instruction到query前面

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment