New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DPO with Axolotl #48
Comments
Hi Johan, thanks for your suggestion. I actually made one, will release it
soon. Feel free to suggest improvements if you're interested, it's not
perfect but it works haha.
…On Thu, Feb 15, 2024, 20:09 JohanWork ***@***.***> wrote:
It is possible to perform DPO with Axolotl. If I were to create a notebook
for DPO fine-tuning, do you think it would be suitable for your repository?
—
Reply to this email directly, view it on GitHub
<#48>, or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ATL5EGUCTEEUJUIC2BRK62LYTZTOPAVCNFSM6AAAAABDK4LN4WVHI2DSMVQWIX3LMV43ASLTON2WKOZSGEZTOMZVHA2TSNI>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>
|
aa nice, looking forward to it. Will do! |
Released it here: https://twitter.com/maximelabonne/status/1759222499131199788 :) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
It is possible to perform DPO with Axolotl. If I were to create a notebook for DPO fine-tuning, do you think it would be suitable for your repository?
The text was updated successfully, but these errors were encountered: