Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can not get the same architecture with same random seed and setting #23

Open
dzk9528 opened this issue Apr 15, 2023 · 0 comments
Open

Comments

@dzk9528
Copy link

dzk9528 commented Apr 15, 2023

Hi. I am run the commands for darts benchamrk search cifar10, but I got different result. The only difference is that because I need to update pytoch version for my gpu is not 1080ti and pytorch updates their methods for computing eigenvalues in later version, I changed

eigenvalues, _ = torch.symeig(ntk) # ascending
to torch.linalg.eigh, but the result geotype is differnt:

Genotype(normal=[('sep_conv_5x5', 0), ('avg_pool_3x3', 1), ('dil_conv_5x5', 0), ('sep_conv_3x3', 2), ('dil_conv_3x3', 0), ('avg_pool_3x3', 1), ('dil_conv_5x5', 1), ('sep_conv_5x5', 2)], normal_concat=[2, 3, 4, 5], reduce=[('sep_conv_3x3', 0), ('dil_conv_5x5', 1), ('dil_conv_3x3', 0), ('max_pool_3x3', 2), ('dil_conv_3x3', 0), ('sep_conv_5x5', 2), ('sep_conv_3x3', 2), ('dil_conv_5x5', 3)], reduce_concat=[2, 3, 4, 5])

which in DART_evaluation give me 96.79% test accuracy. Do you know the reason behind it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant