-
Notifications
You must be signed in to change notification settings - Fork 28
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
FID score #10
Comments
The provided weight has been checked before uploading, the FID score of UNITE paper should be reproduced with the weights. |
Thanks for your quick reply. In fact, i can only reproduce fid = 15.0 in deepfashion dataset. That's weird. Can you supply one ground-truth test image and the corresponding generated image on deepfashion for me to check where the problem is ? I think it may be caused by the data (i use .jpg format) inconsistentce error. |
My setting on deepfashion |
the deepfashion fid score i say is the cocosnet result. And the ade score i calculated is not the same as well. It bothers me a lot. |
Thanks for your reply and your kind help. I will check my results. |
Sorry to bother you, Can you provide the image id or name of these two images? |
It is the first sample in https://github.com/fnzhan/UNITE/blob/main/data/deepfashion_ref_test.txt |
https://drive.google.com/file/d/1o1GteDHPbYldOge3fAjRx1zF9wBtNF6d/view?usp=sharing .Here are the results of cocosnet using the pretrained model, I can only produce 13.05 using the https://github.com/shepnerd/pytorch-fid and 15.00 using the https://github.com/mseitzer/pytorch-fid which are inconsistent with the reported score 14.4 in the paper. can you help to check the data. Thank you in advance. |
|
H, where to download the pretrained model on deepfashion, coco and celeb? I just find ade20 on the provided link |
Do you calculate fid score by comparing the training set and the generated images ? I cannot reproduce the same fid in the paper. And which fid git repo you choose to evaluate the results.
The text was updated successfully, but these errors were encountered: