Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

能否对模型评估后的结果进行可视化操作? #276

Open
JasonYuel opened this issue Jan 8, 2025 · 3 comments
Open

能否对模型评估后的结果进行可视化操作? #276

JasonYuel opened this issue Jan 8, 2025 · 3 comments
Labels
enhancement New feature or request

Comments

@JasonYuel
Copy link

功能描述

我想在对大模型评估之后将评估结果进行可视化分析

请简要描述您希望添加的功能。
存储评估结果,将结果以可视化图表的形式呈现,图标至少要包含评估的基准、使用的数据集、评估的结果(大模型的表现)

需求背景 / Background

为什么需要这个功能? / Why is this feature needed?

预期行为 / Expected Behavior

这个功能应该如何工作? / How should this feature work?

其他信息 / Additional Information

还有其他相关信息吗? / Any other relevant information?

@wangxingjun778
Copy link
Collaborator

可视化的feature已经在开发中了,近期会发布上去。

@Yunnglin Yunnglin added the enhancement New feature or request label Jan 8, 2025
@Yunnglin
Copy link
Collaborator

Yunnglin commented Jan 8, 2025

预计下周末(1.17)之前有一个初版

@Yunnglin
Copy link
Collaborator

evalscope v0.10.0 已发布,支持评估结果进行可视化,注意:请使用最新版本的库进行模型评测后再进行可视化。详情参考 https://evalscope.readthedocs.io/zh-cn/latest/get_started/visulization.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants