Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhancement: Deepseek prefix completion (prefill) #5484

Open
1 task done
elinorgodzilla opened this issue Jan 26, 2025 · 1 comment
Open
1 task done

Enhancement: Deepseek prefix completion (prefill) #5484

elinorgodzilla opened this issue Jan 26, 2025 · 1 comment
Labels
✨ enhancement New feature or request

Comments

@elinorgodzilla
Copy link

elinorgodzilla commented Jan 26, 2025

What features would you like to see added?

Deepseek models are possible to be prefilled just like Claude! As far as I know it's even possible to prefill it's thoughts.
Please consider implementing it, it would be a huge help and this way we could use it's full capability with control over even it's thoughts!
here is the documentation:
https://api-docs.deepseek.com/guides/chat_prefix_completion

More details

https://api-docs.deepseek.com/guides/chat_prefix_completion

Which components are impacted by your request?

General

Pictures

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct
@elinorgodzilla elinorgodzilla added the ✨ enhancement New feature or request label Jan 26, 2025
@insilications
Copy link

With deepseek-r1 this can be EXTREMELY useful. Many reports on twitter show that injecting specific thoughts can help the model escape local optima.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
✨ enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants