jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

[Fix] Split if and only if complete eos string shows up (#477)

Browse Source
This commit is contained in:
Leymore 2023-10-13 06:52:20 -05:00 committed by GitHub
parent 861942ab1b
commit 7d9e386821
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
opencompass/tasks/openicl_eval.py
View File

@ -207,7 +207,7 @@ class OpenICLEvalTask(BaseTask):
if end_str: if end_str:
# TODO: Support calling tokenizer for the accurate eos token # TODO: Support calling tokenizer for the accurate eos token
# and avoid such hardcode # and avoid such hardcode
end_idx = s.find(end_str[:1], start) end_idx = s.find(end_str, start)
if end_idx != -1: if end_idx != -1:
end = end_idx end = end_idx