OpenCompass/opencompass/summarizers
Mo Li 8142f399a8
[Feature] Upgrade the needle-in-a-haystack experiment to Needlebench (#913)
* add needlebench

* simplify needlebench 32k, 128k, 200k for eval

* update act prompt

* fix bug in needlebench summarizer

* add needlebench intro, fix summarizer

* lint summarizer

* fix linting error

* move readme.md

* update readme for needlebench

* update docs of needlebench

* simplify needlebench summarizers
2024-03-04 11:10:52 +08:00
..
subjective [Fix] hotfix for mtbench (#877) 2024-02-06 21:26:47 +08:00
__init__.py reorganize subject files (#801) 2024-01-16 18:03:11 +08:00
circular.py [Feature] Add circular eval (#610) 2023-11-23 16:45:47 +08:00
default.py [Sync] Merge branch 'dev' into zfz/update-keyset-demo (#876) 2024-02-05 23:29:10 +08:00
multi_model.py [Feature] Add multi model viz (#509) 2023-10-30 12:11:33 +08:00
needlebench.py [Feature] Upgrade the needle-in-a-haystack experiment to Needlebench (#913) 2024-03-04 11:10:52 +08:00
summarizer_pretrain.py [Sync] Sync with internal codes 2023.01.08 (#777) 2024-01-08 14:07:24 +00:00