jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
9676d99787
OpenCompass/examples
History
Hoter Young 879b181c1b
add some features (#32) 
* [Feature] Support answer extraction of QwQ when evaluating HuSimpleQA

* [Feature] Support mulit-language summarization in HuSimpleQASummarizer

* [Feature] Support DeepSeep-R1-Distill-Qwen_32B_turbomind
2025-02-14 20:44:53 +08:00
..
eval_academic_leaderboard_202407.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_academic_leaderboard_202412.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_alaya.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_api_demo.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_attack.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_babilong.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_base_demo.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_bluelm_32k_lveval.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_charm_mem.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_charm_rea.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_chat_agent_baseline.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_chat_agent.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_chat_demo.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_chat_last.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_chembench.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_chinese_simpleqa.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_cibench_api.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_cibench.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_circular.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_claude.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_code_passk_repeat_dataset.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_code_passk.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_codeagent.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_codegeex2.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_compassarena_subjectivebench_bradleyterry.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_compassarena_subjectivebench.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_contamination.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_corebench_2409_base_objective.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_corebench_2409_chat_objective.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_corebench_2409_longcontext.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_corebench_2409_subjective.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_dingo.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_ds1000_interpreter.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_edgellm_demo.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_gpt3.5.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_gpt4.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_hellobench.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_hf_llama2.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_hf_llama_7b.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_inference_ppl.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_internlm2_chat_keyset.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_internlm2_keyset.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_internlm_7b.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_internlm_chat_lmdeploy_apiserver.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_internlm_chat_turbomind.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_internlm_flames_chat.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_internlm_lmdeploy_apiserver.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_internlm_math_chat.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_internlm_turbomind.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_internLM.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_judgerbench.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_korbench.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_lightllm.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_livestembench.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_llama2_7b_lveval.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_llama2_7b.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_llama3_instruct.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_llm_compression.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_lmdeploy_demo.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_longbenchv2.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_math_llm_judge_internal.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_math_llm_judge.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_mathbench.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_mmlu_cf.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_mmlu_pro.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_mmlu_with_zero_retriever_overwritten.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_modelscope_datasets.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_multi_prompt_demo.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_musr.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_needlebench.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_OpenHuEval_HuLifeQA.py [Chores] do some minor changes to HuLifeQA (#27) 2025-02-12 21:43:11 +08:00
eval_OpenHuEval_HuMatchingFIB.py update examples and configs 2025-02-10 23:08:43 +08:00
eval_OpenHuEval_HuProverbRea_2CQ.py update examples and configs 2025-02-10 23:08:43 +08:00
eval_OpenHuEval_HuProverbRea_OE.py [Feature] Support answer extraction of QwQ when evaluating HuProverbRea_OE (#31) 2025-02-14 10:16:05 +08:00
eval_OpenHuEval_HuSimpleQA.py add some features (#32) 2025-02-14 20:44:53 +08:00
eval_OpenHuEval_HuStandardFIB.py update examples and configs 2025-02-10 23:08:43 +08:00
eval_PMMEval.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_qwen_7b_chat_lawbench.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_qwen_7b_chat.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_qwen_7b.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_ruler_fix_tokenizer.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_ruler.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_rwkv5_3b.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_simpleqa.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_subjective_alpacaeval_official.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_subjective_bradleyterry.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_subjective.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_teval.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_TheoremQA.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
eval_with_model_dataset_combinations.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00