-
Notifications
You must be signed in to change notification settings - Fork 235
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
any support plan for llava-llama3-70b/12b? any guide for Module optimization ? #689
Comments
@ztfmars Thank you for your feedback
|
hope you can give us some detail guides on personnal method later. or will the intern campus VLM part have an advanced lesson for llm engineer? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
when it will release the version for supporting llava-llama3-70b?
meainwhile, will it will consider of supporting unofficial version like, using llm of llama3-120b?
huggingface link: mlabonne/Meta-Llama-3-120B-Instruct
i think it's very important to enhance the visual encoder funciton, so how can i change the visual encoder instead of just clip vit, suach as other clip or mamba visual version may be better?
or can i just add some personal adapter(just simple MLP may not be a good idea) for visual encoder and finetuning on my on datasets? looking farward to the guidline and hook methods.
i really to want to have a try on personal creativaty!
look forward to your reply, thx!
The text was updated successfully, but these errors were encountered: