OpenCompass/configs/datasets/mmlu
liyucheng09 0b2863039e
[Feature] Contamination analysis for MMLU, Hellaswag, and ARC_c (#699)
* Contamination analysis for ARC_c, mmlu, and Hellaswag

* update `eval_contamination.py`

* update `contamination.py` summarizer

* fix `eval_contamination.py`

* add mmlu groups for contamination analysis
2024-01-08 15:51:48 +08:00
..
mmlu_clean_ppl.py [Feature] Contamination analysis for MMLU, Hellaswag, and ARC_c (#699) 2024-01-08 15:51:48 +08:00
mmlu_gen_4d595a.py Update LightllmApi and Fix mmlu bug (#738) 2023-12-27 13:49:08 +08:00
mmlu_gen_5d1409.py [Refactor] Move fix_id_list to Retriever (#442) 2023-10-07 12:53:41 +08:00
mmlu_gen_23a9a9.py [Refactor] Move fix_id_list to Retriever (#442) 2023-10-07 12:53:41 +08:00
mmlu_gen_79e572.py [Refactor] Move fix_id_list to Retriever (#442) 2023-10-07 12:53:41 +08:00
mmlu_gen_a484b3.py [Refactor] Move fix_id_list to Retriever (#442) 2023-10-07 12:53:41 +08:00
mmlu_gen.py Update LightllmApi and Fix mmlu bug (#738) 2023-12-27 13:49:08 +08:00
mmlu_ppl_ac766d.py [Refactor] Move fix_id_list to Retriever (#442) 2023-10-07 12:53:41 +08:00
mmlu_ppl.py Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
mmlu_zero_shot_gen_47e2c0.py [Sync] some renaming (#641) 2023-11-27 16:06:49 +08:00