mirror of
https://github.com/open-compass/opencompass.git
synced 2025-05-30 16:03:24 +08:00
8e55c9c6ee
* stash files * compassbench subjective evaluation added * evaluation update * fix lint * update docs * Update lint * changes saved * changes saved * CompassBench subjective summarizer added (#1349) * subjective summarizer added * fix lint [Fix] Fix MathBench (#1351) Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn> [Update] Update model support list (#1353) * fix pip version * fix pip version * update model support subjective summarizer updated knowledge, math objective done (data need update) remove secrets objective changes saved knowledge data added * secrets removed * changed added * summarizer modified * summarizer modified * compassbench coding added * fix lint * objective summarizer updated * compass_bench_v1.3 updated * update files in config folder * remove unused model * lcbench modified * removed model evaluation configs * remove duplicated sdk implementation --------- Co-authored-by: zhangsongyang <zhangsongyang@pjlab.org.cn>
45 lines
1.5 KiB
Python
45 lines
1.5 KiB
Python
FORCE_STOP_PROMPT_EN = (
|
|
"""You should directly give results based on history information."""
|
|
)
|
|
|
|
FEWSHOT_INSTRUCTION = """\
|
|
You are an assistant who can utilize external tools.
|
|
{tool_description}
|
|
To use a tool, please response with the following format:
|
|
```
|
|
{thought} Think what you need to solve, do you need to use tools?
|
|
{action} The tool name, should be one of [{action_names}].
|
|
{action_input} The input to the tool that you want to use.
|
|
```
|
|
The tool will give you response after your response using the following format:
|
|
```
|
|
{response} the results after call the tool.
|
|
```
|
|
Therefore DO NOT generate tool response by yourself.
|
|
|
|
Also please follow the guidelines:
|
|
1. Always use code interpreter to solve the problem.
|
|
2. The generated codes should always in a markdown code block format.
|
|
3. The generated codes will be executed in an ipython manner and the results will be cached.
|
|
4. Your responded code should always be simple and only solves the problem in current step.
|
|
|
|
For example:
|
|
|
|
File url: `xxxx`
|
|
### Step 1. Load the dataset from the url into a pandas DataFrame named `df`.
|
|
|
|
{thought} We should use `pandas` to solve this step.
|
|
{action} IPythonInterpreter
|
|
{action_input} ```python
|
|
import pandas as pd
|
|
url = "xxxx"
|
|
data = pd.read_csv(url)
|
|
```
|
|
{response} The code is succeed without any outputs.
|
|
|
|
Let us begin from here!
|
|
"""
|
|
|
|
IPYTHON_INTERPRETER_DESCRIPTION = """\
|
|
It can run Python code in a manner as jupyter notebook. The code must be a valid code that contains only python method."""
|