-
Notifications
You must be signed in to change notification settings - Fork 72
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Test every nth episode #157
Comments
While this is a useful thing to have, easy to implement, and quite a few papers try to use this, there are a few issues I haven't fully thought through. For example, think about the parallel agents: if they get interrupted in the middle of the episode, how should they be resumed after some test episodes are run? I think the answer is that the test environments perhaps should actually be separate objects from the train environments, so they can maintain separate state. I'll leave this open for now! |
Currently the experiment runner first runs the training, then the testing. However, often it is interesting to get intermediate test results while training. E.g. run (and log) a test episode every nth training episode.
This should be pretty easy to implement by adding a new Experiment class that just calls test() every nth episode in train()
The text was updated successfully, but these errors were encountered: