Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Train and benchmark several RL algorithms #45

Open
ghost opened this issue Jan 29, 2019 · 3 comments
Open

Train and benchmark several RL algorithms #45

ghost opened this issue Jan 29, 2019 · 3 comments

Comments

@ghost
Copy link

ghost commented Jan 29, 2019

🚀 Feature Request

Part of #42. Depends on #44. Once an environment is set up, it will be easy to train several of the RL algorithms provided by pytorch. All of these algorithms should be bench marked and a team discussion take place on which one to use for production training. The computation library for performing these tasks will be caffe2 as it is easy to deploy on production cloud services. The focus is on 2019: creating a generic tool for this is not essential, but it will be very beneficial for future years, and the task of #51.

@Ivan-Z
Copy link
Member

Ivan-Z commented Jan 29, 2019

Are we for sure going for Keras over Pytorch?

@ghost
Copy link
Author

ghost commented Jan 29, 2019

Yes, keras-rl lets us run tensorflow which is never going anywhere, and is also pretty damn fast. So it gives us speed and security.

@gabrielmok gabrielmok self-assigned this Feb 16, 2019
@ghost
Copy link
Author

ghost commented Feb 25, 2019

We are now going to be using pytorch for several reasons, after talking to industry experts on machine learning. The main reasons are:

  1. Faster development speed. The number one reason highlighted by every expert, regardless of whether they preferred pytorch or not, is that pytorch has undoubtedly the fastest development cycle of any machine learning library.
  2. Brighter future: pytorch is growing faster than tensorflow/keras and is expected to continue. It's development community is, at the moment, growing faster as well, and with it comes exceptional libraries and support.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

No branches or pull requests

2 participants