Skip to content

Commit 774b512

Browse files
committed
update beir eval
1 parent ef51aeb commit 774b512

2 files changed

Lines changed: 2 additions & 0 deletions

File tree

examples/evaluation/README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -140,6 +140,7 @@ python -m FlagEmbedding.evaluation.beir \
140140
--eval_output_method markdown \
141141
--eval_output_path ./beir/beir_eval_results.md \
142142
--eval_metrics ndcg_at_10 recall_at_100 \
143+
--ignore_identical_ids True \
143144
--embedder_name_or_path BAAI/bge-m3 \
144145
--reranker_name_or_path BAAI/bge-reranker-v2-m3 \
145146
--devices cuda:0 cuda:1 \

examples/evaluation/beir/eval_beir.sh

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -18,6 +18,7 @@ eval_args="\
1818
--eval_output_method markdown \
1919
--eval_output_path ./beir/beir_eval_results.md \
2020
--eval_metrics ndcg_at_10 recall_at_100 \
21+
--ignore_identical_ids True \
2122
"
2223

2324
model_args="\

0 commit comments

Comments
 (0)