OpenCompass/opencompass/datasets/korbench/korbench_dataset_config/config.yaml
Yufeng Zhao 300adc31e8
[Feature] Add Korbench dataset (#1713)
* first version for korbench

* first stage for korbench

* korbench_1

* korbench_1

* korbench_1

* korbench_1

* korbench_1_revised

* korbench_combined_1

* korbench_combined_1

* kor_combined

* kor_combined

* update

---------

Co-authored-by: MaiziXiao <xxllcc1993@gmail.com>
2024-11-25 20:11:27 +08:00

16 lines
212 B
YAML

# Necessary
response_key: 'response'
error_key: 'error'
id_key:
- 'idx'
- 'step'
prompt_key: 'prompt'
# Optional
history_key: 'history'
status_key: 'status'
save_prompt: True
max_tokens: 2000
max_rounds: 5