Skip to content

[New Model] <xxy2024mimir> #204

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
3 tasks done
xiaoyunxxy opened this issue Dec 28, 2024 · 4 comments
Closed
3 tasks done

[New Model] <xxy2024mimir> #204

xiaoyunxxy opened this issue Dec 28, 2024 · 4 comments
Labels
new-model Addition of a new model to the Leaderboard/Model Zoo

Comments

@xiaoyunxxy
Copy link

Paper Information

  • Paper Title: MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustness
  • Paper URL: https://arxiv.org/abs/2312.04960
  • Paper authors: Xiaoyun Xu, Shujian Yu, Zhuoran Liu, Stjepan Picek

Leaderboard Claim(s)

Model 1

  • Architecture: Swin-base
  • Dataset: ImageNet-1K
  • Threat Model: Linf
  • eps: 4/255
  • Clean accuracy: 76.62
  • Robust accuracy: 55.90
  • Additional data: false
  • Evaluation method: AutoAttack
  • Checkpoint and code: checkpoint code log.

Model 2

  • Architecture: Swin-large
  • Dataset: ImageNet-1K
  • Threat Model: Linf
  • eps: 4/255
  • Clean accuracy: 78.62
  • Robust accuracy: 59.68
  • Additional data: false
  • Evaluation method: AutoAttack
  • Checkpoint and code: checkpoint code log

The pre-process of ImageNet-1K for evaluation can be found here, link

Model Zoo:

  • I want to add my models to the Model Zoo (check if true)
  • I use an architecture that is included among
    those here or in timm. If not, I added the link to the architecture implementation so that it can be added.
  • I agree to release my model(s) under MIT license (check if true) OR under a custom license, located here: (put the custom license URL here if a custom license is needed. If no URL is specified, we assume that you are fine with MIT)
@xiaoyunxxy xiaoyunxxy added the new-model Addition of a new model to the Leaderboard/Model Zoo label Dec 28, 2024
@xiaoyunxxy
Copy link
Author

Hi,

It has been about one month since we submitted our models. I'd like to kindly ask if you have the chance to review our models. We would appreciate your feedback.

In addition, please use the code provided in the link for Swin architectures. The link will directly go to the code for Swin-base and Swin-large. Because our hyper-parameter may be slightly different from the timm.

Best

@fra31
Copy link
Member

fra31 commented Feb 2, 2025

Hi,

thanks for the submission, and sorry for the delay. I've added the models with 5ff2500. Let me know if it looks fine.

@xiaoyunxxy
Copy link
Author

Hi,

It looks fine. Thank you very much.

@fra31
Copy link
Member

fra31 commented Feb 5, 2025

Leaderboard updated with RobustBench/robustbench.github.io#16.

@fra31 fra31 closed this as completed Feb 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
new-model Addition of a new model to the Leaderboard/Model Zoo
Projects
None yet
Development

No branches or pull requests

2 participants