OpenCompass/opencompass/summarizers
Linchen Xiao 8e55c9c6ee
[Update] Compassbench v1.3 (#1396)
* stash files

* compassbench subjective evaluation added

* evaluation update

* fix lint

* update docs

* Update lint

* changes saved

* changes saved

* CompassBench subjective summarizer added (#1349)

* subjective summarizer added

* fix lint

[Fix] Fix MathBench (#1351)

Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>

[Update] Update model support list (#1353)

* fix pip version

* fix pip version

* update model support

subjective summarizer updated

knowledge, math objective done (data need update)

remove secrets

objective changes saved

knowledge data added

* secrets removed

* changed added

* summarizer modified

* summarizer modified

* compassbench coding added

* fix lint

* objective summarizer updated

* compass_bench_v1.3 updated

* update files in config folder

* remove unused model

* lcbench modified

* removed model evaluation configs

* remove duplicated sdk implementation

---------

Co-authored-by: zhangsongyang <zhangsongyang@pjlab.org.cn>
2024-08-12 19:09:19 +08:00
..
subjective [Update] Compassbench v1.3 (#1396) 2024-08-12 19:09:19 +08:00
__init__.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
circular.py [Feature] Add circular eval (#610) 2023-11-23 16:45:47 +08:00
default.py [Feature] Update pip install (#1324) 2024-07-29 18:32:50 +08:00
llm_compression.py [Feature] Adding support for LLM Compression Evaluation (#1108) 2024-04-30 10:51:01 +08:00
multi_faceted.py [Sync] bump version (#1204) 2024-05-28 23:09:59 +08:00
multi_model.py [Feature] Add multi model viz (#509) 2023-10-30 12:11:33 +08:00
needlebench.py [Doc] Update NeedleBench Docs (#1330) 2024-07-18 13:16:19 +08:00
summarizer_pretrain.py [Sync] Sync with internal codes 2023.01.08 (#777) 2024-01-08 14:07:24 +00:00