New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

功能请求：支持豆包前缀缓存和会话缓存 #2026

Open

5 tasks done

laoshancun opened this issue Jan 10, 2025 · 0 comments · May be fixed by #2027

Open

5 tasks done

功能请求：支持豆包前缀缓存和会话缓存 #2026

laoshancun opened this issue Jan 10, 2025 · 0 comments · May be fixed by #2027

Labels

laoshancun commented Jan 10, 2025

例行检查

我已确认目前没有类似 issue
我已确认我已升级到最新版本
我已完整查看过项目 README，已确定现有版本无法满足需求
我理解并愿意跟进此 issue，协助测试和提供反馈
我理解并认可上述内容，并理解项目维护者精力有限，不遵循规则的 issue 可能会被无视或直接关闭

功能描述
前缀缓存
 Session 缓存
应用场景
Doubao-pro-32k 在使用缓存的情况下，单价降幅达80%。

输入token单价0.0008 元/千tokens
输入命中缓存单价0.00016 元/千tokens

laoshancun added the enhancement label

laoshancun linked a pull request

that will close this issue

feat: add session/prefix cache for doubao #2027

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment