2023-07-04 21:34:55 +08:00
|
|
|
Welcome to OpenCompass' documentation!
|
|
|
|
|
==========================================
|
|
|
|
|
|
2023-07-13 09:07:53 +08:00
|
|
|
Getting started with OpenCompass
|
2023-07-04 21:34:55 +08:00
|
|
|
-------------------------------
|
|
|
|
|
|
2023-07-13 09:07:53 +08:00
|
|
|
To help you quickly familiarized with OpenCompass, we recommend you to walk through the following documents in order:
|
2023-07-04 21:34:55 +08:00
|
|
|
|
2023-07-13 09:07:53 +08:00
|
|
|
- First read the GetStarted_ section set up the environment, and run a mini experiment.
|
2023-07-04 21:34:55 +08:00
|
|
|
|
2023-07-13 09:07:53 +08:00
|
|
|
- Then learn its basic usage through the UserGuides_.
|
2023-07-04 21:34:55 +08:00
|
|
|
|
2023-07-13 09:07:53 +08:00
|
|
|
- If you want to tune the prompts, refer to the Prompt_.
|
2023-07-04 21:34:55 +08:00
|
|
|
|
2023-07-13 09:07:53 +08:00
|
|
|
- If you want to customize some modules, like adding a new dataset or model, we have provided the AdvancedGuides_.
|
2023-07-04 21:34:55 +08:00
|
|
|
|
2023-07-13 09:07:53 +08:00
|
|
|
- There are more handy tools, such as prompt viewer and lark bot reporter, all presented in Tools_.
|
2023-07-04 21:34:55 +08:00
|
|
|
|
2023-07-13 09:07:53 +08:00
|
|
|
We always welcome *PRs* and *Issues* for the betterment of OpenCompass.
|
2023-07-04 21:34:55 +08:00
|
|
|
|
|
|
|
|
.. _GetStarted:
|
|
|
|
|
.. toctree::
|
|
|
|
|
:maxdepth: 1
|
|
|
|
|
:caption: Get Started
|
|
|
|
|
|
2023-10-07 11:49:40 +08:00
|
|
|
get_started/installation.md
|
|
|
|
|
get_started/quick_start.md
|
|
|
|
|
get_started/faq.md
|
2023-07-04 21:34:55 +08:00
|
|
|
|
|
|
|
|
.. _UserGuides:
|
|
|
|
|
.. toctree::
|
|
|
|
|
:maxdepth: 1
|
2023-07-06 15:47:09 +08:00
|
|
|
:caption: User Guides
|
2023-07-04 21:34:55 +08:00
|
|
|
|
2023-09-07 14:21:39 +08:00
|
|
|
user_guides/framework_overview.md
|
2023-07-04 21:34:55 +08:00
|
|
|
user_guides/config.md
|
2023-07-13 09:07:53 +08:00
|
|
|
user_guides/datasets.md
|
2023-07-04 21:34:55 +08:00
|
|
|
user_guides/models.md
|
|
|
|
|
user_guides/evaluation.md
|
|
|
|
|
user_guides/experimentation.md
|
2023-08-01 11:47:04 +08:00
|
|
|
user_guides/metrics.md
|
2023-08-23 11:18:01 +08:00
|
|
|
user_guides/summarizer.md
|
2023-07-04 21:34:55 +08:00
|
|
|
|
|
|
|
|
.. _Prompt:
|
|
|
|
|
.. toctree::
|
|
|
|
|
:maxdepth: 1
|
|
|
|
|
:caption: Prompt
|
|
|
|
|
|
2023-08-11 11:36:09 +08:00
|
|
|
prompt/overview.md
|
2023-07-04 21:34:55 +08:00
|
|
|
prompt/prompt_template.md
|
|
|
|
|
prompt/meta_template.md
|
2023-08-11 11:36:09 +08:00
|
|
|
prompt/chain_of_thought.md
|
2023-07-04 21:34:55 +08:00
|
|
|
|
2023-08-17 11:03:16 +08:00
|
|
|
|
|
|
|
|
.. _AdvancedGuides:
|
|
|
|
|
.. toctree::
|
|
|
|
|
:maxdepth: 1
|
|
|
|
|
:caption: Advanced Guides
|
|
|
|
|
|
|
|
|
|
advanced_guides/new_dataset.md
|
|
|
|
|
advanced_guides/new_model.md
|
|
|
|
|
advanced_guides/evaluation_turbomind.md
|
|
|
|
|
advanced_guides/code_eval_service.md
|
2023-09-22 18:58:29 +08:00
|
|
|
advanced_guides/multimodal_eval.md
|
2023-09-15 15:06:53 +08:00
|
|
|
advanced_guides/prompt_attack.md
|
2023-09-18 17:06:00 +08:00
|
|
|
advanced_guides/longeval.md
|
2023-10-27 16:27:24 +08:00
|
|
|
advanced_guides/subjective_evaluation.md
|
2023-08-17 11:03:16 +08:00
|
|
|
|
2023-07-04 21:34:55 +08:00
|
|
|
.. _Tools:
|
|
|
|
|
.. toctree::
|
|
|
|
|
:maxdepth: 1
|
|
|
|
|
:caption: tools
|
|
|
|
|
|
|
|
|
|
tools.md
|
|
|
|
|
|
|
|
|
|
.. _Notes:
|
|
|
|
|
.. toctree::
|
|
|
|
|
:maxdepth: 1
|
|
|
|
|
:caption: Notes
|
|
|
|
|
|
|
|
|
|
notes/contribution_guide.md
|
|
|
|
|
|
|
|
|
|
Indexes & Tables
|
|
|
|
|
==================
|
|
|
|
|
|
|
|
|
|
* :ref:`genindex`
|
2023-07-06 12:58:44 +08:00
|
|
|
* :ref:`search`
|
