Skip to content

Commit 2a782b9

Browse files
clementchadebecclementchadebec
authored
Multiply/Partially/Combination IWAE (#54)
* work on CIWAE and MIWAE * add PIWAE * minor change in Coupled Optimizer Trainer * update repro script * prepare repro * add DynBinDataset to scripts * fix number of training samples * update test calbacks with trainer update * fix issue in callback * add eval model * add eval mode * add examples and update readme * add reproduction results * apply black and isort * clean up scripts * clean up scripts * clean up scripts * removed unecessary * prepare release
1 parent 454eae9 commit 2a782b9

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

54 files changed

+5220
-68
lines changed

‎.gitignore

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -59,6 +59,8 @@ examples/scripts/configs/*
5959
examples/notebooks/mlruns/*
6060
mlruns/*
6161
examples/scripts/reproducibility/reproducibility/*
62+
examples/scripts/reproducibility/sync.ipynb
63+
6264

6365

6466

‎README.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -86,7 +86,10 @@ VAE with Inverse Autoregressive Flows (VAE_IAF) | [![Open In Colab](https://col
8686
| Disentangled Beta Variational Autoencoder (DisentangledBetaVAE) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/clementchadebec/benchmark_VAE/blob/main/examples/notebooks/models_training/disentangled_beta_vae_training.ipynb) | [link](https://arxiv.org/abs/1804.03599) |
8787
| Disentangling by Factorising (FactorVAE) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/clementchadebec/benchmark_VAE/blob/main/examples/notebooks/models_training/factor_vae_training.ipynb) | [link](https://arxiv.org/abs/1802.05983) | |
8888
| Beta-TC-VAE (BetaTCVAE) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/clementchadebec/benchmark_VAE/blob/main/examples/notebooks/models_training/beta_tc_vae_training.ipynb) | [link](https://arxiv.org/abs/1802.04942) | [link](https://github.com/rtqichen/beta-tcvae)
89-
| Importance Weighted Autoencoder (IWAE) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/clementchadebec/benchmark_VAE/blob/main/examples/notebooks/models_training/iwae_training.ipynb) | [link](https://arxiv.org/abs/1509.00519v4) | [link](https://github.com/yburda/iwae) |
89+
| Importance Weighted Autoencoder (IWAE) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/clementchadebec/benchmark_VAE/blob/main/examples/notebooks/models_training/iwae_training.ipynb) | [link](https://arxiv.org/abs/1509.00519v4) | [link](https://github.com/yburda/iwae)
90+
| Multiply Importance Weighted Autoencoder (MIWAE) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/clementchadebec/benchmark_VAE/blob/main/examples/notebooks/models_training/miwae_training.ipynb) | [link](https://arxiv.org/abs/1802.04537) |
91+
| Partially Importance Weighted Autoencoder (PIWAE) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/clementchadebec/benchmark_VAE/blob/main/examples/notebooks/models_training/piwae_training.ipynb) | [link](https://arxiv.org/abs/1802.04537) |
92+
| Combination Importance Weighted Autoencoder (CIWAE) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/clementchadebec/benchmark_VAE/blob/main/examples/notebooks/models_training/ciwae_training.ipynb) | [link](https://arxiv.org/abs/1802.04537) | |
9093
| VAE with perceptual metric similarity (MSSSIM_VAE) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/clementchadebec/benchmark_VAE/blob/main/examples/notebooks/models_training/ms_ssim_vae_training.ipynb) | [link](https://arxiv.org/abs/1511.06409) |
9194
| Wasserstein Autoencoder (WAE) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/clementchadebec/benchmark_VAE/blob/main/examples/notebooks/models_training/wae_training.ipynb) | [link](https://arxiv.org/abs/1711.01558) | [link](https://github.com/tolstikhin/wae) |
9295
| Info Variational Autoencoder (INFOVAE_MMD) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/clementchadebec/benchmark_VAE/blob/main/examples/notebooks/models_training/info_vae_training.ipynb) | [link](https://arxiv.org/abs/1706.02262) | |

‎docs/source/models/autoencoders/ciwae.rst

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
**********************************
2+
CIWAE
3+
**********************************
4+
5+
.. automodule::
6+
pythae.models.ciwae
7+
8+
.. autoclass:: pythae.models.CIWAEConfig
9+
:members:
10+
11+
.. autoclass:: pythae.models.CIWAE
12+
:members:

‎docs/source/models/autoencoders/miwae.rst

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
**********************************
2+
MIWAE
3+
**********************************
4+
5+
.. automodule::
6+
pythae.models.miwae
7+
8+
.. autoclass:: pythae.models.MIWAEConfig
9+
:members:
10+
11+
.. autoclass:: pythae.models.MIWAE
12+
:members:

‎docs/source/models/autoencoders/models.rst

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -17,6 +17,9 @@ Autoencoders
1717
factorvae
1818
betatcvae
1919
iwae
20+
ciwae
21+
miwae
22+
piwae
2023
msssimvae
2124
wae
2225
infovae
@@ -49,6 +52,9 @@ Available Models
4952
~pythae.models.FactorVAE
5053
~pythae.models.BetaTCVAE
5154
~pythae.models.IWAE
55+
~pythae.models.CIWAE
56+
~pythae.models.MIWAE
57+
~pythae.models.PIWAE
5258
~pythae.models.MSSSIM_VAE
5359
~pythae.models.WAE_MMD
5460
~pythae.models.INFOVAE_MMD

‎docs/source/models/autoencoders/piwae.rst

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
**********************************
2+
PIWAE
3+
**********************************
4+
5+
.. automodule::
6+
pythae.models.piwae
7+
8+
.. autoclass:: pythae.models.PIWAEConfig
9+
:members:
10+
11+
.. autoclass:: pythae.models.PIWAE
12+
:members:

‎docs/source/models/pythae.models.rst

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -31,6 +31,9 @@ Available Autoencoders
3131
~pythae.models.FactorVAE
3232
~pythae.models.BetaTCVAE
3333
~pythae.models.IWAE
34+
~pythae.models.CIWAE
35+
~pythae.models.MIWAE
36+
~pythae.models.PIWAE
3437
~pythae.models.MSSSIM_VAE
3538
~pythae.models.WAE_MMD
3639
~pythae.models.INFOVAE_MMD

‎examples/notebooks/custom_dataset.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@
1616
"outputs": [],
1717
"source": [
1818
"# Install the library\n",
19-
"%pip install git+https://github.com/clementchadebec/benchmark_VAE.git"
19+
"%pip install pythae"
2020
]
2121
},
2222
{

‎examples/notebooks/mlflow_experiment_monitoring.ipynb

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@
1616
"outputs": [],
1717
"source": [
1818
"# Install the library\n",
19-
"%pip install git+https://github.com/clementchadebec/benchmark_VAE.git"
19+
"%pip install pythae"
2020
]
2121
},
2222
{

0 commit comments

Comments
 (0)