OpenCompass/opencompass/datasets/calm/evaluation/accuracy/choice.py
Peng Bo edd0ffdf70
Calm dataset (#1287)
* add calm dataset

* modify config max_out_len

* update README

* Modify README

* update README

* update README

* update README

* update README

* update README

* add summarizer and modify readme

* delete summarizer config comment

* update summarizer

* modify same response to all questions

* update README
2024-07-26 11:48:16 +08:00

4 lines
165 B
Python

def compute_acc(gt_list, pred_list):
correct_num = sum(pred == gt for gt, pred in zip(gt_list, pred_list))
acc = correct_num / len(gt_list)
return acc