Linchen Xiao
|
835bf75a36
|
[Feature] Add long context evaluation for base models (#1666)
* [Update] Add base long context evaluation
* update
|
2024-11-08 10:53:29 +08:00 |
|
Songyang Zhang
|
e7681943f3
|
[Feature] Update the max_out_len for many models (#1559)
|
2024-09-24 21:52:28 +08:00 |
|
Songyang Zhang
|
6997990c93
|
[Feature] Update Models (#1518)
* Update Models
* Update
* Update humanevalx
* Update
* Update
|
2024-09-12 23:35:30 +08:00 |
|
Fengzhe Zhou
|
a32f21a356
|
[Sync] Sync with internal codes 2024.06.28 (#1279)
|
2024-06-28 14:16:34 +08:00 |
|
Xu Song
|
808582d952
|
Fix VLLM argument error (#1207)
|
2024-05-29 10:14:08 +08:00 |
|
Fengzhe Zhou
|
2954913d9b
|
[Sync] bump version (#1204)
|
2024-05-28 23:09:59 +08:00 |
|
Fengzhe Zhou
|
62dbf04708
|
[Sync] update github workflow (#1156)
|
2024-05-14 22:42:23 +08:00 |
|
Fengzhe Zhou
|
aa2dd2b58c
|
[Format] Add config lints (#892)
|
2024-05-14 15:35:58 +08:00 |
|
Fengzhe Zhou
|
7505b3cadf
|
[Feature] Add huggingface apply_chat_template (#1098)
* add TheoremQA with 5-shot
* add huggingface_above_v4_33 classes
* use num_worker partitioner in cli
* update theoremqa
* update TheoremQA
* add TheoremQA
* rename theoremqa -> TheoremQA
* update TheoremQA output path
* rewrite many model configs
* update huggingface
* further update
* refine configs
* update configs
* update configs
* add configs/eval_llama3_instruct.py
* add summarizer multi faceted
* update bbh datasets
* update configs/models/hf_llama/lmdeploy_llama3_8b_instruct.py
* rename class
* update readme
* update hf above v4.33
|
2024-05-14 14:50:16 +08:00 |
|
Fengzhe Zhou
|
8c85edd1cd
|
[Sync] deprecate old mbpps (#1064)
|
2024-04-19 20:49:46 +08:00 |
|
Fengzhe Zhou
|
b39f501563
|
[Sync] update taco (#1030)
|
2024-04-09 17:50:23 +08:00 |
|
Mo Li
|
f2af49337d
|
[Feature] Add ATC Choice Version (#1019)
* Squashed commit of the following:
commit c48ad194c3976dc63d1b60d8c8ab2d5ff9e1cbfe
Author: DseidLi <2568818204@qq.com>
Date: Tue Apr 2 16:57:43 2024 +0800
add atc_choice
commit 3ac6efea29619573e6fac8fa3cce464853dcead0
Merge: 2d4e559 8e3a9c3
Author: DseidLi <2568818204@qq.com>
Date: Tue Apr 2 16:41:38 2024 +0800
Merge branch 'atc_choice' into atc_add_choice
commit 8e3a9c396a3e5546d3faf584183f6fd60b974d5e
Merge: 150a036 0a6a03f
Author: DseidLi <2568818204@qq.com>
Date: Tue Mar 26 04:47:07 2024 +0800
Merge branch 'main' into atc_choice
Conflicts:
configs/summarizers/needlebench.py
opencompass/datasets/needlebench/multi.py
opencompass/datasets/needlebench/origin.py
opencompass/datasets/needlebench/parallel.py
commit 150a036d6d990f26a57c974d1af83d88c31a0f9d
Merge: 8d6ac9a 940dd18
Author: DseidLi <2568818204@qq.com>
Date: Wed Mar 20 03:49:08 2024 +0800
Merge branch 'needlebench_fix' into atc_choice
commit 8d6ac9a1a43b1c9d0f0ea27e7d58968a203ea898
Author: DseidLi <2568818204@qq.com>
Date: Wed Mar 20 03:41:49 2024 +0800
optimize needlebench code
commit 940dd18a4270f24bc69edd2a780182c68918e1a9
Author: DseidLi <2568818204@qq.com>
Date: Wed Mar 20 03:39:46 2024 +0800
fix vllm
commit d8be6877bc41051f3edcc0421c462c834c0f1c9a
Merge: ecad78a 2527fda
Author: DseidLi <2568818204@qq.com>
Date: Tue Mar 19 21:07:08 2024 +0800
Merge remote-tracking branch 'origin/add_1M_dataset' into atc_choice
commit 2527fda8a5
Author: DseidLi <2568818204@qq.com>
Date: Tue Mar 19 16:03:40 2024 +0800
add model configs
commit 75425acdf8
Author: DseidLi <2568818204@qq.com>
Date: Tue Mar 19 16:02:15 2024 +0800
add prompt postion args
commit 367ba1ba61
Author: DseidLi <2568818204@qq.com>
Date: Wed Feb 28 21:40:00 2024 +0800
add Needlebench-1000K configs
commit ecad78af14c4bb00fe325779114b384c57ab30bf
Author: DseidLi <2568818204@qq.com>
Date: Thu Mar 14 22:08:32 2024 +0800
fix atc
commit 08772c0787b18872abadc9ffec3223941a5ee0c2
Merge: 9f3f8cf caf1cf8
Author: DseidLi <2568818204@qq.com>
Date: Thu Mar 14 22:07:28 2024 +0800
Merge branch 'main' into atc_choice
Conflicts:
configs/datasets/needlebench/readme.md
configs/datasets/needlebench/readme_zh-CN.md
configs/summarizers/needlebench.py
opencompass/datasets/needlebench/atc.py
opencompass/summarizers/needlebench.py
commit 9f3f8cfb4452722734d334114ac1d14110e57406
Author: DseidLi <2568818204@qq.com>
Date: Thu Mar 14 21:35:53 2024 +0800
add atc-choice test
commit 52be7c1202376b4e09821188b826f1a805328129
Author: DseidLi <2568818204@qq.com>
Date: Wed Mar 6 02:54:15 2024 +0800
update needlebench randomseed and add vllm qwen14b
commit fc1effce596ae2e5ece4933e8cd34aef8e64a6f9
Merge: 4e747ed caf1cf8
Author: DseidLi <2568818204@qq.com>
Date: Wed Mar 6 02:51:14 2024 +0800
Merge branch 'main' into add_model_configs
commit 31834f9b23af3354ac3581ec86d693d0f05cdd1c
Merge: 7dabc82 120bf8b
Author: DseidLi <2568818204@qq.com>
Date: Sun Mar 3 23:29:42 2024 +0800
Merge branch 'main' of https://github.com/open-compass/opencompass into atc_choice
commit 4e747ed1988ddbcfcc7fff334601259ade72d363
Author: DseidLi <2568818204@qq.com>
Date: Sun Mar 3 22:15:25 2024 +0800
add internlm2-lmdeploy model and gemma configs
commit 7dabc828123d711c8cf834d6aab4137bb55e85ed
Author: DseidLi <2568818204@qq.com>
Date: Sat Mar 2 17:26:15 2024 +0800
add atc choice version -ZH
commit 996f8ae43d
Author: DseidLi <2568818204@qq.com>
Date: Wed Feb 28 16:58:56 2024 +0800
update readme for needlebench
commit f7266e873c
Author: DseidLi <2568818204@qq.com>
Date: Wed Feb 28 16:44:53 2024 +0800
move readme.md
commit 1c7375681d
Author: DseidLi <2568818204@qq.com>
Date: Wed Feb 28 16:38:31 2024 +0800
fix linting error
commit b6524f3ebf
Author: DseidLi <2568818204@qq.com>
Date: Wed Feb 28 16:33:51 2024 +0800
lint summarizer
commit c0d1190e39
Author: DseidLi <2568818204@qq.com>
Date: Wed Feb 28 16:29:03 2024 +0800
add needlebench intro, fix summarizer
commit 0965baf785
Author: DseidLi <2568818204@qq.com>
Date: Mon Feb 26 13:31:26 2024 +0800
fix bug in needlebench summarizer
commit 5d32b31eb8
Author: DseidLi <2568818204@qq.com>
Date: Sat Feb 24 03:19:08 2024 +0800
update act prompt
commit af82a7f085
Merge: 32bf9fe 53fe788
Author: DseidLi <2568818204@qq.com>
Date: Fri Feb 23 17:50:32 2024 +0800
Merge remote-tracking branch 'upstream/main' into needlebench
commit 32bf9fe802
Author: DseidLi <2568818204@qq.com>
Date: Fri Feb 23 17:31:32 2024 +0800
simplify needlebench 32k, 128k, 200k for eval
commit a7cb025e05
Author: DseidLi <2568818204@qq.com>
Date: Fri Feb 23 14:48:58 2024 +0800
add needlebench
* fix summarizer
* remove repeated code
* remove chinese comments
|
2024-04-07 15:46:20 +08:00 |
|
Fengzhe Zhou
|
32f40a8f83
|
[Sync] Sync with internal codes 2023.01.08 (#777)
|
2024-01-08 14:07:24 +00:00 |
|
Fengzhe Zhou
|
3a68083ecc
|
[Sync] update configs (#734)
|
2023-12-25 21:59:16 +08:00 |
|
Fengzhe Zhou
|
d3de5c41fb
|
[Sync] update model configs (#574)
|
2023-11-13 15:15:34 +08:00 |
|