New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问评测的原理是什么呀，是人工打分的吗，如果是客观题是直接比较返回的答案的字符串，主观题是人工评判答案吗 #47

Open

starplatinum3 opened this issue Jul 26, 2024 · 1 comment

starplatinum3 commented Jul 26, 2024

No description provided.

elmliu commented Aug 16, 2024

参考项目论文实验的Evaluation Metrics部分，封闭式选择题就是算准确度，开放式的题目用GPT4判断两两模型间谁的回答更优秀，计算每个模型的胜出率

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment