This repository is an unofficial PyTorch implementation of Feedforward and Transformer based Networks (such as mlp-mixer, vit, ...). most experiments are performed on small benchmark datasets.
| Model | Params (M) | CIFAR10 | CIFAR100 | SVHN |
|---|---|---|---|---|
| MLP-Mixer | 1.13 | 84.73% | 56.69% | 93.88% |
| ResMLP | 1.09 | 88.12% | 64.72% | 95.98% |
| Conv-Mixer | 29.54 | 82.41% | 57.19% | 93.43% |
| Vit | 18.94 | 83.41% | 56.10% | 94.84% |