Fengzhe Zhou
|
1d3a26c732
|
[Doc] quick start swap tabs (#1263)
* [doc] quick start swap tabs
* update docs
* update
* update
* update
* update
* update
* update
* update
|
2024-07-05 23:51:42 +08:00 |
|
Songyang Zhang
|
409a042d93
|
[Feature] Add InternLM2.5 (#1286)
* [Feature] Add InternLM2.5
* Update
* update readme
---------
Co-authored-by: zhangsongyang <zhangsongyang@pjlab.org.cn>
Co-authored-by: Leymore <zfz-960727@163.com>
|
2024-07-04 20:10:31 +08:00 |
|
zhulinJulia24
|
167cfdcca3
|
[ci] update daily testcase (#1285)
* Update daily-run-test.yml
* Create eval_regression_chat.py
* Delete .github/scripts/.github/scripts/eval_regression_chat.py
* Create eval_regression_chat.py
* Update pr-run-test.yml
* Update daily-run-test.yml
* Update daily-run-test.yml
* Update daily-run-test.yml
* Update oc_score_baseline.yaml
* Update oc_score_assert.py
* Update daily-run-test.yml
* Update daily-run-test.yml
* Update oc_score_baseline.yaml
* Update oc_score_assert.py
* Update oc_score_assert.py
* fix lint
* update
* update
* update
* update
* update
* update
* update
* update
* update
* Update daily-run-test.yml
* update
---------
Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn>
|
2024-07-03 18:56:09 +08:00 |
|
Fengzhe Zhou
|
a32f21a356
|
[Sync] Sync with internal codes 2024.06.28 (#1279)
|
2024-06-28 14:16:34 +08:00 |
|
Fengzhe Zhou
|
0b50112dc1
|
[Fix] Rollback opt model configs (#1213)
|
2024-05-30 00:03:22 +08:00 |
|
Xu Song
|
808582d952
|
Fix VLLM argument error (#1207)
|
2024-05-29 10:14:08 +08:00 |
|
Fengzhe Zhou
|
2954913d9b
|
[Sync] bump version (#1204)
|
2024-05-28 23:09:59 +08:00 |
|
bittersweet1999
|
31afe87026
|
fix yi-chat template (#1178)
|
2024-05-21 18:14:12 +08:00 |
|
Fengzhe Zhou
|
2b3d4150f3
|
[Sync] update evaluator (#1175)
|
2024-05-21 14:22:46 +08:00 |
|
Fengzhe Zhou
|
5de85406ce
|
[Sync] add OC16 entry (#1171)
|
2024-05-17 16:50:58 +08:00 |
|
Fengzhe Zhou
|
8ea2c404d7
|
[Feat] enable HuggingFacewithChatTemplate with --accelerator via cli (#1163)
* enable HuggingFacewithChatTemplate with --accelerator via cli
* rm vllm_internlm2_chat_7b
|
2024-05-15 21:51:07 +08:00 |
|
Fengzhe Zhou
|
62dbf04708
|
[Sync] update github workflow (#1156)
|
2024-05-14 22:42:23 +08:00 |
|
Fengzhe Zhou
|
aa2dd2b58c
|
[Format] Add config lints (#892)
|
2024-05-14 15:35:58 +08:00 |
|
Fengzhe Zhou
|
7505b3cadf
|
[Feature] Add huggingface apply_chat_template (#1098)
* add TheoremQA with 5-shot
* add huggingface_above_v4_33 classes
* use num_worker partitioner in cli
* update theoremqa
* update TheoremQA
* add TheoremQA
* rename theoremqa -> TheoremQA
* update TheoremQA output path
* rewrite many model configs
* update huggingface
* further update
* refine configs
* update configs
* update configs
* add configs/eval_llama3_instruct.py
* add summarizer multi faceted
* update bbh datasets
* update configs/models/hf_llama/lmdeploy_llama3_8b_instruct.py
* rename class
* update readme
* update hf above v4.33
|
2024-05-14 14:50:16 +08:00 |
|
Alexander Lam
|
a71122ee18
|
[Feature] Add Qwen1.5 MoE 7b and Mixtral 8x22b model configs (#1123)
* added qwen moe and mixtral 8x22 model configs
* updated README files news section
|
2024-05-09 11:04:26 +08:00 |
|
liushz
|
17735f0c13
|
Fix Llama-3 meta template (#1079)
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
|
2024-04-24 16:46:25 +08:00 |
|
Fengzhe Zhou
|
a256753221
|
[Feature] Add LLaMA-3 Series Configs (#1065)
* add LLaMA-3 Series configs
* update readme
|
2024-04-22 14:39:31 +08:00 |
|
Fengzhe Zhou
|
8c85edd1cd
|
[Sync] deprecate old mbpps (#1064)
|
2024-04-19 20:49:46 +08:00 |
|
Fengzhe Zhou
|
b39f501563
|
[Sync] update taco (#1030)
|
2024-04-09 17:50:23 +08:00 |
|
Mo Li
|
f2af49337d
|
[Feature] Add ATC Choice Version (#1019)
* Squashed commit of the following:
commit c48ad194c3976dc63d1b60d8c8ab2d5ff9e1cbfe
Author: DseidLi <2568818204@qq.com>
Date: Tue Apr 2 16:57:43 2024 +0800
add atc_choice
commit 3ac6efea29619573e6fac8fa3cce464853dcead0
Merge: 2d4e559 8e3a9c3
Author: DseidLi <2568818204@qq.com>
Date: Tue Apr 2 16:41:38 2024 +0800
Merge branch 'atc_choice' into atc_add_choice
commit 8e3a9c396a3e5546d3faf584183f6fd60b974d5e
Merge: 150a036 0a6a03f
Author: DseidLi <2568818204@qq.com>
Date: Tue Mar 26 04:47:07 2024 +0800
Merge branch 'main' into atc_choice
Conflicts:
configs/summarizers/needlebench.py
opencompass/datasets/needlebench/multi.py
opencompass/datasets/needlebench/origin.py
opencompass/datasets/needlebench/parallel.py
commit 150a036d6d990f26a57c974d1af83d88c31a0f9d
Merge: 8d6ac9a 940dd18
Author: DseidLi <2568818204@qq.com>
Date: Wed Mar 20 03:49:08 2024 +0800
Merge branch 'needlebench_fix' into atc_choice
commit 8d6ac9a1a43b1c9d0f0ea27e7d58968a203ea898
Author: DseidLi <2568818204@qq.com>
Date: Wed Mar 20 03:41:49 2024 +0800
optimize needlebench code
commit 940dd18a4270f24bc69edd2a780182c68918e1a9
Author: DseidLi <2568818204@qq.com>
Date: Wed Mar 20 03:39:46 2024 +0800
fix vllm
commit d8be6877bc41051f3edcc0421c462c834c0f1c9a
Merge: ecad78a 2527fda
Author: DseidLi <2568818204@qq.com>
Date: Tue Mar 19 21:07:08 2024 +0800
Merge remote-tracking branch 'origin/add_1M_dataset' into atc_choice
commit 2527fda8a5
Author: DseidLi <2568818204@qq.com>
Date: Tue Mar 19 16:03:40 2024 +0800
add model configs
commit 75425acdf8
Author: DseidLi <2568818204@qq.com>
Date: Tue Mar 19 16:02:15 2024 +0800
add prompt postion args
commit 367ba1ba61
Author: DseidLi <2568818204@qq.com>
Date: Wed Feb 28 21:40:00 2024 +0800
add Needlebench-1000K configs
commit ecad78af14c4bb00fe325779114b384c57ab30bf
Author: DseidLi <2568818204@qq.com>
Date: Thu Mar 14 22:08:32 2024 +0800
fix atc
commit 08772c0787b18872abadc9ffec3223941a5ee0c2
Merge: 9f3f8cf caf1cf8
Author: DseidLi <2568818204@qq.com>
Date: Thu Mar 14 22:07:28 2024 +0800
Merge branch 'main' into atc_choice
Conflicts:
configs/datasets/needlebench/readme.md
configs/datasets/needlebench/readme_zh-CN.md
configs/summarizers/needlebench.py
opencompass/datasets/needlebench/atc.py
opencompass/summarizers/needlebench.py
commit 9f3f8cfb4452722734d334114ac1d14110e57406
Author: DseidLi <2568818204@qq.com>
Date: Thu Mar 14 21:35:53 2024 +0800
add atc-choice test
commit 52be7c1202376b4e09821188b826f1a805328129
Author: DseidLi <2568818204@qq.com>
Date: Wed Mar 6 02:54:15 2024 +0800
update needlebench randomseed and add vllm qwen14b
commit fc1effce596ae2e5ece4933e8cd34aef8e64a6f9
Merge: 4e747ed caf1cf8
Author: DseidLi <2568818204@qq.com>
Date: Wed Mar 6 02:51:14 2024 +0800
Merge branch 'main' into add_model_configs
commit 31834f9b23af3354ac3581ec86d693d0f05cdd1c
Merge: 7dabc82 120bf8b
Author: DseidLi <2568818204@qq.com>
Date: Sun Mar 3 23:29:42 2024 +0800
Merge branch 'main' of https://github.com/open-compass/opencompass into atc_choice
commit 4e747ed1988ddbcfcc7fff334601259ade72d363
Author: DseidLi <2568818204@qq.com>
Date: Sun Mar 3 22:15:25 2024 +0800
add internlm2-lmdeploy model and gemma configs
commit 7dabc828123d711c8cf834d6aab4137bb55e85ed
Author: DseidLi <2568818204@qq.com>
Date: Sat Mar 2 17:26:15 2024 +0800
add atc choice version -ZH
commit 996f8ae43d
Author: DseidLi <2568818204@qq.com>
Date: Wed Feb 28 16:58:56 2024 +0800
update readme for needlebench
commit f7266e873c
Author: DseidLi <2568818204@qq.com>
Date: Wed Feb 28 16:44:53 2024 +0800
move readme.md
commit 1c7375681d
Author: DseidLi <2568818204@qq.com>
Date: Wed Feb 28 16:38:31 2024 +0800
fix linting error
commit b6524f3ebf
Author: DseidLi <2568818204@qq.com>
Date: Wed Feb 28 16:33:51 2024 +0800
lint summarizer
commit c0d1190e39
Author: DseidLi <2568818204@qq.com>
Date: Wed Feb 28 16:29:03 2024 +0800
add needlebench intro, fix summarizer
commit 0965baf785
Author: DseidLi <2568818204@qq.com>
Date: Mon Feb 26 13:31:26 2024 +0800
fix bug in needlebench summarizer
commit 5d32b31eb8
Author: DseidLi <2568818204@qq.com>
Date: Sat Feb 24 03:19:08 2024 +0800
update act prompt
commit af82a7f085
Merge: 32bf9fe 53fe788
Author: DseidLi <2568818204@qq.com>
Date: Fri Feb 23 17:50:32 2024 +0800
Merge remote-tracking branch 'upstream/main' into needlebench
commit 32bf9fe802
Author: DseidLi <2568818204@qq.com>
Date: Fri Feb 23 17:31:32 2024 +0800
simplify needlebench 32k, 128k, 200k for eval
commit a7cb025e05
Author: DseidLi <2568818204@qq.com>
Date: Fri Feb 23 14:48:58 2024 +0800
add needlebench
* fix summarizer
* remove repeated code
* remove chinese comments
|
2024-04-07 15:46:20 +08:00 |
|
Mo Li
|
0a6a03fe1a
|
[Feature] update needlebench and configs (#986)
* add Needlebench-1000K configs
* add prompt postion args
* add model configs
* Update parallel.py
* fix lint
|
2024-03-25 18:05:01 +08:00 |
|
Jingming
|
c2d4717be2
|
[Fix] Fix a bug in internlm2 series configs (#977)
|
2024-03-15 15:21:35 +08:00 |
|
Jingming
|
4c1533e59e
|
[Fix] fix the config's name of deepseek-coder (#964)
|
2024-03-12 19:36:52 +08:00 |
|
Fengzhe Zhou
|
bdd85358cc
|
[Sync] update 20240308 (#953)
|
2024-03-11 22:34:19 +08:00 |
|
Jingming
|
66d3aa4c01
|
[Feature] Add configs of deepseek-coder (#943)
|
2024-03-05 11:38:28 +08:00 |
|
Fengzhe Zhou
|
b03d5dc531
|
[Sync] Sync Internal (#941)
|
2024-03-04 14:42:36 +08:00 |
|
Mo Li
|
120bf8b399
|
add vllm model configs (#938)
|
2024-03-01 17:31:51 +08:00 |
|
bittersweet1999
|
001e77fea2
|
[Feature] add support for gemini (#931)
* add gemini
* add gemini
* add gemini
|
2024-02-28 19:38:34 +08:00 |
|
Xu Song
|
6d04decab4
|
[Fix] Fix moss template config (#897)
|
2024-02-21 11:19:24 +08:00 |
|
Fengzhe Zhou
|
2b7d376e3d
|
[Fix] Fix chatglm2 config (#893)
|
2024-02-19 14:55:53 +08:00 |
|
Fengzhe Zhou
|
9119e2ac39
|
[Fix] rename qwen2-beta -> qwen1.5 (#894)
|
2024-02-19 14:55:35 +08:00 |
|
Fengzhe Zhou
|
d34ba11106
|
[Sync] Merge branch 'dev' into zfz/update-keyset-demo (#876)
|
2024-02-05 23:29:10 +08:00 |
|
RangiLyu
|
40a2441deb
|
Update hf_internlm2_chat template (#823)
* Update hf_internlm2_chat template
* Update 20B
|
2024-01-19 18:21:47 +08:00 |
|
Mo Li
|
dcc32ed856
|
[Fix] Update yi 200k config (#815)
|
2024-01-18 20:54:24 +08:00 |
|
Fengzhe Zhou
|
b4afe3e7c1
|
[Sync] Add InternLM2 Keyset Evaluation Demo (#807)
Co-authored-by: zhangyifan1 <zhangyifan1@pjlab.org.cn>
|
2024-01-17 13:48:12 +08:00 |
|
Fengzhe Zhou
|
32f40a8f83
|
[Sync] Sync with internal codes 2023.01.08 (#777)
|
2024-01-08 14:07:24 +00:00 |
|
Chris Liu
|
3eb225a5e6
|
[Feature] Support LLaMA2-Accessory (#732)
* Support LLaMA2-Accessory
* remove strip
* clear imports
* reformat
* fix lint
* fix lint
* update readme
* update readme
* update readme
* update readme
|
2024-01-02 20:48:51 +08:00 |
|
bittersweet1999
|
8728287a55
|
fix erro in configs (#750)
|
2023-12-28 11:53:07 +00:00 |
|
bittersweet1999
|
dfd9ac0fd9
|
[Feature] Add other judgelm prompts for Alignbench (#731)
* add judgellm prompts
* add judgelm prompts
* update import info
* fix situation that no abbr in config
* fix situation that no abbr in config
* add summarizer for other judgellm
* change config name
* add maxlen
* add maxlen
* dict assert
* dict assert
* fix strings
* fix strings
|
2023-12-27 17:54:53 +08:00 |
|
Fengzhe Zhou
|
3a68083ecc
|
[Sync] update configs (#734)
|
2023-12-25 21:59:16 +08:00 |
|
bittersweet1999
|
97c2068bd9
|
[Feature] Add JudgeLLMs (#710)
* add judgellms
* add judgellms
* add sub_size_partition
* add docs
* add ref
|
2023-12-19 18:40:25 +08:00 |
|
Songyang Zhang
|
637628a70f
|
[Doc] Update Doc for Alignbench (#707)
* update alignmentbench
* update alignmentbench
* update doc
* update
* update
|
2023-12-15 15:07:25 +08:00 |
|
Songyang Zhang
|
bfe4aa2af5
|
[Fix] Update alignmentbench (#704)
* update alignmentbench
* update alignmentbench
* update alignmentbench
|
2023-12-14 18:24:21 +08:00 |
|
Xiaoyu Zhang
|
82a533a690
|
add rwkv-5-3b model (#666)
* support rwkv5-3b learnboard
* update rwkv-5-3b config
* update config
* refine
* fix bug
* update config
* refine
* reduce batch size
* refine
* reduce batch size to avoid oom in special datasets
* Update huggingface.py
* Update huggingface.py
|
2023-12-12 18:15:19 +08:00 |
|
bittersweet1999
|
465308e430
|
[Feature] Add Subjective Evaluation (#680)
* new version of subject
* fixed draw
* fixed draw
* fixed draw
* done
* done
* done
* done
* fixed lint
|
2023-12-11 22:22:11 +08:00 |
|
Hubert
|
e78857ac36
|
[Sync] minor test (#683)
|
2023-12-11 17:42:53 +08:00 |
|
Songyang Zhang
|
e25c5f9525
|
[Enhancement] Update API Interface and Mixtral (#681)
* [Enhancement] Update API interface
* [Enhancement] Update API interface
* Update mixtral
* Update readme
|
2023-12-10 13:29:26 +08:00 |
|
Fengzhe Zhou
|
3a354bd1da
|
add qwen and deepseek configs (#672)
|
2023-12-07 20:29:00 +08:00 |
|
Fengzhe Zhou
|
9083dea683
|
[Sync] some renaming (#641)
|
2023-11-27 16:06:49 +08:00 |
|
Fengzhe Zhou
|
d4d1330a5a
|
[Sync] Fix cmnli, fix vicuna meta template, fix longbench postprocess and other minor fixes (#625)
|
2023-11-23 14:05:59 +08:00 |
|