OpenCompass/requirements/runtime.txt

absl-py
accelerate>=0.19.0
cpm_kernels
datasets>=2.12.0
einops>=0.5.0
evaluate>=0.3.0
func_timeout
fuzzywuzzy
gradio-client
h5py
httpx==0.27.2
huggingface_hub
immutabledict
importlib-metadata
jieba
json5
jsonlines
mmengine-lite
nltk>=3.7
numpy>=1.23.4,<2.0.0
openai
OpenCC
opencv-python-headless
pandas<2.0.0
prettytable
protobuf
pyext
python-Levenshtein
rank_bm25==0.2.2
rapidfuzz
requests>=2.31.0
retrying
rich
rouge
-e git+https://github.com/Isaac-JL-Chen/rouge_chinese.git@master#egg=rouge_chinese
rouge_score
sacrebleu
scikit_learn==1.5.0
seaborn
sentence_transformers
tabulate
tiktoken
timeout_decorator
tokenizers>=0.13.3
torch>=1.13.1
tqdm>=4.64.1
transformers>=4.29.1
tree-sitter==0.21.3
tree_sitter_languages>=1.10.2
typer
[Fix] requirements (#229) 2023-08-18 14:34:20 +08:00			`absl-py`
OpenCompass Public MR 2023-07-05 11:15:21 +08:00			`accelerate>=0.19.0`
[Enhancement] Test linting in CI and fix existing linting errors (#69) * [Enhancement] Test linting in CI * fix linting 2023-07-17 15:59:10 +08:00			`cpm_kernels`
OpenCompass Public MR 2023-07-05 11:15:21 +08:00			`datasets>=2.12.0`
[Update] Customizable tokenizer for RULER (#1731) * Customizable tokenizer for RULER * Relax requirements 2024-12-19 18:02:11 +08:00			`einops>=0.5.0`
OpenCompass Public MR 2023-07-05 11:15:21 +08:00			`evaluate>=0.3.0`
[Sync] Sync with internal codes 2023.01.08 (#777) 2024-01-08 22:07:24 +08:00			`func_timeout`
[Dataset] LongBench (#236) Co-authored-by: wangchonghua <wangchonghua@pjlab.org.cn> 2023-08-21 14:15:20 +08:00			`fuzzywuzzy`
[Update] Update Skywork/Qwen-QwQ (#1728) * Update JuderBench * Support O1-style Prompts * Update Code * Update OpenAI * Update BigCodeBench * Update BigCodeBench * Update BigCodeBench * Update BigCodeBench * Update BigCodeBench * Update 2024-12-05 19:30:43 +08:00			`gradio-client`
[Feature] Add support for SciCode (#1417) * add SciCode * add SciCode * add SciCode * add SciCode * add SciCode * add SciCode * add SciCode * add SciCode w/ bg * add scicode * Update README.md * Update README.md * Delete configs/eval_SciCode.py * rename * 1 * rename * Update README.md * Update scicode.py * Update scicode.py * fix some bugs * Update * Update --------- Co-authored-by: root <HariSeldon0> Co-authored-by: tonysy <sy.zhangbuaa@gmail.com> 2024-08-22 13:42:25 +08:00			`h5py`
[Update] Update requirement and deepseek configurations (#1764) 2024-12-17 10:16:47 +08:00			`httpx==0.27.2`
[Update] Support AIME-24 Evaluation for DeepSeek-R1 series (#1888) * Update * Update * Update * Update 2025-02-25 20:34:41 +08:00			`huggingface_hub`
[Fix] Fix IFEval (#906) * fix ifeval * fix ifeval * fix ifeval * fix ifeval 2024-02-22 16:51:34 +08:00			`immutabledict`
[Feature] BABILong Dataset added (#1684) * update * update * update * update 2024-11-14 15:32:43 +08:00			`importlib-metadata`
[Enhancement] Test linting in CI and fix existing linting errors (#69) * [Enhancement] Test linting in CI * fix linting 2023-07-17 15:59:10 +08:00			`jieba`
Update CIBench (#1089) * modify the requirements/runtime.txt: numpy==1.23.4 --> numpy>=1.23.4 * update cibench: dataset and evluation * cibench summarizer bug * update cibench * move extract_code import --------- Co-authored-by: zhangchuyu@pjlab.org.cn <zhangchuyu@pjlab.org.cn> Co-authored-by: Leymore <zfz-960727@163.com> 2024-04-26 18:46:02 +08:00			`json5`
[Update] Update Skywork/Qwen-QwQ (#1728) * Update JuderBench * Support O1-style Prompts * Update Code * Update OpenAI * Update BigCodeBench * Update BigCodeBench * Update BigCodeBench * Update BigCodeBench * Update BigCodeBench * Update 2024-12-05 19:30:43 +08:00			`jsonlines`
[Doc] Update README and requirements. (#622) * update readme * update doc 2023-11-22 19:16:54 +08:00			`mmengine-lite`
[Update] Customizable tokenizer for RULER (#1731) * Customizable tokenizer for RULER * Relax requirements 2024-12-19 18:02:11 +08:00			`nltk>=3.7`
add ",<2.0.0" to "numpy>=1.23.4" in requirements/runtime.txt, as pandas<2.0.0 doesn't compatible with numpy>=2.0.0 (#1267) 2024-06-24 11:03:42 +08:00			`numpy>=1.23.4,<2.0.0`
[Enhancement] Test linting in CI and fix existing linting errors (#69) * [Enhancement] Test linting in CI * fix linting 2023-07-17 15:59:10 +08:00			`openai`
[Feature] Add lawbench (#460) * add lawbench * update requirements * update 2023-10-13 19:51:36 +08:00			`OpenCC`
[Feat] support pr merge test ci (#669) * [Feat] support ci * [Feat] support ci * [Feat] support ci * [Feat] support ci * init docs * init docs * init docs 2023-12-11 14:12:04 +08:00			`opencv-python-headless`
[Enhancement] Test linting in CI and fix existing linting errors (#69) * [Enhancement] Test linting in CI * fix linting 2023-07-17 15:59:10 +08:00			`pandas<2.0.0`
New subjective judgement (#660) * TabMWP * TabMWP * fixed * fixed * fixed * done * done * done * add new subjective judgement * add new subjective judgement * add new subjective judgement * add new subjective judgement * add new subjective judgement * modified to a more general way * modified to a more general way * final * final * add summarizer * add new summarize * fixed * fixed * fixed --------- Co-authored-by: caomaosong <caomaosong@pjlab.org.cn> 2023-12-06 13:28:33 +08:00			`prettytable`
[Sync] bump version (#1204) 2024-05-28 23:09:59 +08:00			`protobuf`
[Feature] Support LiveCodeBench (#1617) * Update * Update LCB * Update * Update * Update * Update * Update 2024-10-21 20:50:39 +08:00			`pyext`
[Feature] Add lawbench (#460) * add lawbench * update requirements * update 2023-10-13 19:51:36 +08:00			`python-Levenshtein`
OpenCompass Public MR 2023-07-05 11:15:21 +08:00			`rank_bm25==0.2.2`
[Fix] requirements (#229) 2023-08-18 14:34:20 +08:00			`rapidfuzz`
[Feature] Support import configs/models/summarizers from whl (#1376) * [Feature] Support import configs/models/summarizers from whl * Update LCBench configs * Update * Update * Update * Update * update * Update * Update * Update * Update * Update 2024-08-01 00:42:48 +08:00			`requests>=2.31.0`
[Feature] Support the reasoning from BaiLing LLM (#1541) * [Feature] Support the reasoning from BaiLing LLM This commit includes the access to BaiLing LLM and gets the reasoning. * Add the api example The example of evalute bailing api * Revise the generation arguments Based on current experiment, we update some generation arguments for better reasoning * [fix] set the batch size * Retry under flowcontrol of serverside * add dependent package into requirement.txt add dependent package retrying to clean up the pre-comment check. * correct the file names and make the file copy correct the file names. copy the files under configs to opencompass * fix the lint issue --------- Co-authored-by: christopher.dy <christopher.dy@antgroup.com> 2024-09-26 16:49:52 +08:00			`retrying`
[Feature] Add multi model viz (#509) * add viz_multi_model.py tool * Modify the viz_multi_model.py script according to the review * highlight multiple optimal scores --------- Co-authored-by: wq.chu <wq.chu@tianrang-inc.com> Co-authored-by: Leymore <zfz-960727@163.com> 2023-10-30 12:11:33 +08:00			`rich`
[Dataset] LongBench (#236) Co-authored-by: wangchonghua <wangchonghua@pjlab.org.cn> 2023-08-21 14:15:20 +08:00			`rouge`
Update runtime.txt to fix rouge_chinese bugs. (#803) * Update runtime.txt to fix rouge_chinese bugs. the wheel file of rouge_chinese will overwrite the rouge package, causing bugs. Replacing it to the github code, which is the correct version. * fix PEP format issues * fix PEP format issues * enable pip install --------- Co-authored-by: 郭琦鹏 <guoqipeng@pjlab.org.cn> Co-authored-by: Leymore <zfz-960727@163.com> 2024-01-29 19:18:22 +08:00			`-e git+https://github.com/Isaac-JL-Chen/rouge_chinese.git@master#egg=rouge_chinese`
[Fix] requirements (#229) 2023-08-18 14:34:20 +08:00			`rouge_score`
[Sync] update (#517) 2023-10-27 20:31:22 +08:00			`sacrebleu`
[Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00			`scikit_learn==1.5.0`
[Sync] update github token (#475) 2023-10-13 19:50:54 +08:00			`seaborn`
[Fix] Fix compatible issue 2025-03-03 15:35:57 +08:00			`sentence_transformers`
[Enhancement] Test linting in CI and fix existing linting errors (#69) * [Enhancement] Test linting in CI * fix linting 2023-07-17 15:59:10 +08:00			`tabulate`
			`tiktoken`
[Feature] Add lawbench (#460) * add lawbench * update requirements * update 2023-10-13 19:51:36 +08:00			`timeout_decorator`
[Enhancement] Test linting in CI and fix existing linting errors (#69) * [Enhancement] Test linting in CI * fix linting 2023-07-17 15:59:10 +08:00			`tokenizers>=0.13.3`
OpenCompass Public MR 2023-07-05 11:15:21 +08:00			`torch>=1.13.1`
[Feature] Support import configs/models/summarizers from whl (#1376) * [Feature] Support import configs/models/summarizers from whl * Update LCBench configs * Update * Update * Update * Update * update * Update * Update * Update * Update * Update 2024-08-01 00:42:48 +08:00			`tqdm>=4.64.1`
OpenCompass Public MR 2023-07-05 11:15:21 +08:00			`transformers>=4.29.1`
[Update] Update Skywork/Qwen-QwQ (#1728) * Update JuderBench * Support O1-style Prompts * Update Code * Update OpenAI * Update BigCodeBench * Update BigCodeBench * Update BigCodeBench * Update BigCodeBench * Update BigCodeBench * Update 2024-12-05 19:30:43 +08:00			`tree-sitter==0.21.3`
			`tree_sitter_languages>=1.10.2`
[Feature] Add multi model viz (#509) * add viz_multi_model.py tool * Modify the viz_multi_model.py script according to the review * highlight multiple optimal scores --------- Co-authored-by: wq.chu <wq.chu@tianrang-inc.com> Co-authored-by: Leymore <zfz-960727@163.com> 2023-10-30 12:11:33 +08:00			`typer`