We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
目前 model ratio 和 completion ratio 是集中维护的,这带来几个问题:
更为合理的方案是,参考 ModelList 的维护方法,每个 Adapter 维护一个 RatioMap,在 DoResponse 返回 usage 的时候连带 ratio 一起返回,或者为 adapter 添加一个获取 ratio 的接口。 进一步,ModelList 可以被这个 RatioMap 替代。
DoResponse
涉及到的改动量可能比较大,目前只是提出一个想法,欢迎大家讨论。
The text was updated successfully, but these errors were encountered:
No branches or pull requests
目前 model ratio 和 completion ratio 是集中维护的,这带来几个问题:
更为合理的方案是,参考 ModelList 的维护方法,每个 Adapter 维护一个 RatioMap,在
DoResponse
返回 usage 的时候连带 ratio 一起返回,或者为 adapter 添加一个获取 ratio 的接口。进一步,ModelList 可以被这个 RatioMap 替代。
涉及到的改动量可能比较大,目前只是提出一个想法,欢迎大家讨论。
The text was updated successfully, but these errors were encountered: