Junnan Liu 8e8d4f1c64 [Feature] Support G-Pass@k and LiveMathBench (#1772) ... * support G-Pass@k and livemathbench * fix bugs * fix comments of GPassKEvaluator * update saved details of GPassKEvaluator * update saved details of GPassKEvaluator * fix eval api configs & update openai_api for ease of debugging * update huggingface path * fix method name of G-Pass@k * fix default value of eval_model_name * refactor G-Pass@k evaluator * log generation params for each backend * fix evaluation resume * add notimplementerror		2024-12-30 16:59:39 +08:00
..
cli	[Feature] Support import configs/models/summarizers from whl (#1376)	2024-08-01 00:42:48 +08:00
configs	[Feature] Support G-Pass@k and LiveMathBench (#1772)	2024-12-30 16:59:39 +08:00
datasets	[Feature] Support G-Pass@k and LiveMathBench (#1772)	2024-12-30 16:59:39 +08:00
lagent	Update CIBench (#1089)	2024-04-26 18:46:02 +08:00
metrics	[Feat] Support multi-modal evaluation on MME benchmark. (#197)	2023-08-21 15:53:20 +08:00
models	[Feature] Support G-Pass@k and LiveMathBench (#1772)	2024-12-30 16:59:39 +08:00
openicl	[Feature] Support G-Pass@k and LiveMathBench (#1772)	2024-12-30 16:59:39 +08:00
partitioners	[Fix] fix duplicate error in partitioner (#1552)	2024-09-23 19:45:21 +08:00
runners	[Update] Volc status exception handle (#1780)	2024-12-26 15:43:24 +08:00
summarizers	[Fix] Fix model summarizer abbr (#1789)	2024-12-27 14:45:08 +08:00
tasks	[Update] Update Skywork/Qwen-QwQ (#1728)	2024-12-05 19:30:43 +08:00
utils	[Fix] Fix vllm max_seq_len parameter transfer (#1745)	2024-12-16 21:44:36 +08:00
__init__.py	[Bump] Bump version to 0.3.8 (#1765)	2024-12-17 19:17:18 +08:00
registry.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00