-
Notifications
You must be signed in to change notification settings - Fork 24
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Results are not same #28
Comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hello, I successfully loaded the pre-trained model given for mrw dataset using the following command in eval.py script
"checkpoint = torch.load(args.ckpt)
model.load_state_dict(checkpoint, strict=False)"
but the results are not same as given in the article or in github repo.
The results generated by evaluating pre-trained model "mrw_pvse.pth"
Loading dataset
Computing results... (eval_on_gpu=True)
Images: 5000, Sentences: 5000
rsum: 0.48
Average i2t Recall: 0.07
Image to text: 0.02 0.06 0.14 2509.00 (0.50) 2509.74 (0.50)
Average t2i Recall: 0.09
Text to image: 0.02 0.06 0.18 2500.00 (0.50) 2500.98 (0.50)
Am I doing any mistake
The text was updated successfully, but these errors were encountered: