Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

changes to allow training with validataion data #14

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

dribnet
Copy link
Contributor

@dribnet dribnet commented Jan 25, 2016

This is a work in progress to allow training with a validation set. As written, the validation data set is required, but I would like to make it optional with a command line switch. I'm posting this as a pull request to solicit feedback before continuing.

Using a local set of MNIST image files, I can launch this via:

fauxtograph train --gpu --shape 28 28 --color_channels 1 \
  --epoch 100 --batch 100 --kl_ratio 0.1 --save_freq 10 \
  /data/mnist/png/mnist_train \
  /data/mnist/png/mnist_test \
  ./models/mnist_split1

The output to the console is:

epoch: 1
train_total_loss=0.0686056688428, train_rec_loss = 0.0683446452022, train_kl_loss = 0.00260960473679                                                                   
validation_total_loss=0.0668101087213, validation_rec_loss = 0.0655997917056, validation_kl_loss = 0.0121031077579                                                     
epoch: 2
train_total_loss=0.0662013068795, train_rec_loss = 0.0648920089006, train_kl_loss = 0.0130931474268                                                                    
validation_total_loss=0.0661751106381, validation_rec_loss = 0.0648957043886, validation_kl_loss = 0.0127941668034                                                     
epoch: 3
train_total_loss=0.0652597472072, train_rec_loss = 0.0632267221808, train_kl_loss = 0.0203300975263                                                                    
validation_total_loss=0.0652015134692, validation_rec_loss = 0.0633098185062, validation_kl_loss = 0.0189169626683                                                     
...

This can be cleaned up further, but wanted to first start a discussion about whether this type of functionality would be a worthwhile addition to the codebase.

@dribnet dribnet mentioned this pull request Feb 1, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant