-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
how to use the image-guided trained weights? #9
Comments
Hi, thanks for your interest in VisText! You can train and evaluate the image-guided models the same way you use the text-models. For instance, the following command will run an image + scene graph model with prefix tuning:
Like you said, the pre trained weights for the image-guided models are on our dataset page. We also have the chart images and image features there in case you need it. Let me know if there is anything else I can help with! Angie |
Hi, Thank you for your greate wprk. I was able to train the model with image_guided and datatable input model. Now I am using this trained weights to test on a new dataset. but unlike the text_only models, this image-guided weigts only have .pth file, and doesn't include any other configration files.
I am not sure how to use this .pth file, where can I find other config files? It would be relaly helpful if you could provide some of instructions.
Thank you for your reply.
The text was updated successfully, but these errors were encountered: