We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Describe the bug Eval 模块使用时 C-Eval 进行测试时,会大量重复出现 [INFO:modelscope] dataset_type: 1 [INFO:modelscope] dataset_type: 1 [INFO:modelscope] dataset_type: 1 这让我怀疑程序是否卡死,直到想起C-Eval拥有大量推理科目时才明白程序在做什么
希望能优化这个问题
The text was updated successfully, but these errors were encountered:
正常情况只log一次dataset_type; 但是如果像mmlu、ceval这类有几十个subset的情况,每个subset都会打印一次。最新的modelscope master分支已删除该log;后续小版本1.14.1会自动更新。
Sorry, something went wrong.
wangxingjun778
No branches or pull requests
Describe the bug
Eval 模块使用时 C-Eval 进行测试时,会大量重复出现
[INFO:modelscope] dataset_type: 1
[INFO:modelscope] dataset_type: 1
[INFO:modelscope] dataset_type: 1
这让我怀疑程序是否卡死,直到想起C-Eval拥有大量推理科目时才明白程序在做什么
希望能优化这个问题
The text was updated successfully, but these errors were encountered: