nvidia-docker v2? #1

Activity

1. rporres commented on Nov 24, 2017

   

   rporres

   on Nov 24, 2017

   More actions

   Above links are broken. I guess it's because 2.0 branch was merged into master recently by means of NVIDIA/nvidia-docker@fe18749
2. thomas-riccardi commented on Nov 24, 2017

   

   thomas-riccardi

   on Nov 24, 2017

   Author

   More actions

   @rporres indeed, I updated my comment.

   👍React with 👍1Reacted by Rafa Porres Molina
3. mcuadros commented on Dec 22, 2017

   

   mcuadros

   on Dec 22, 2017

   Contributor

   More actions

   Its requires any changes? The current version was done for bare docker, not even nvidia-docker 1.0
4. thomas-riccardi commented on Dec 22, 2017

   

   thomas-riccardi

   on Dec 22, 2017

   Last edited by thomas-riccardi

   Author

   More actions

   using nvidia-docker v2 would simplify the docker run part: no need to add:

   --volumes-from nvidia-driver \
       --env PATH=$PATH:/opt/nvidia/bin/ \
       --env LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/nvidia/lib \
       $(for d in /dev/nvidia*; do echo -n "--device $d "; done) \
   

   So what change is required is in fact installing nvidia-docker v2 in coreos, and removing the nvidia-driver container.
5. trevex commented on Jan 29, 2018

   

   trevex

   on Jan 29, 2018

   Contributor

   More actions

   I used the following steps to install nvidia-docker v2 (very hacky though):

   1. install nvidia driver
   2. instead of the volume I simply copy the files to the host, e.g.

   /usr/bin/docker run --rm --volume /opt/nvidia/current:/output srcd/coreos-nvidia:${VERSION} cp -a /opt/nvidia/. /output/
   

   3. install libnvidia-container
   4. (build and) install nvidia-container-runtime
   5. create small bash scripts in /run/torcx/bin for nvidia-container{-runtime,-runtime-hook,-cli} to make sure they are accessible by docker and libraries are in LD_LIBRARY_PATH
   6. create /etc/docker/daemon.json and set default runtime to nvidia
   7. restart docker
   8. add the nvidia-docker bash scripts

   There is only one issue currently: The nvidia-container-runtime somehow (even though same commit as installed runc) has a regression. And fails to run containers with docker run --security-opt=no-new-privileges (coreos/bugs#1796).

   👍React with 👍1Reacted by Lars Hanerud
6. lsjostro commented on Feb 2, 2018

   

   lsjostro

   on Feb 2, 2018

   More actions

   We have it working as well (nvidia-docker v2 + coreos + k8s device plugin). We will try to clean it up and hopefully be able to share it soonish.
7. lsjostro commented on Feb 9, 2018

   

   lsjostro

   on Feb 9, 2018

   More actions

   went for this instead
   GoogleCloudPlatform/container-engine-accelerators#54
8. thomas-riccardi commented on Feb 9, 2018

   

   thomas-riccardi

   on Feb 9, 2018

   Author

   More actions

   @lsjostro I would be interested in having your previous "nvidia-docker v2 + coreos" version, even if not cleaned up and production-ready: nvidia-docker v2 enables sharing GPUs between containers (at the cost of losing k8s scheduling) that device drivers solutions don't support (and won't for the foreseeable future).

   In any case, GoogleCloudPlatform/container-engine-accelerators#54 is useful too, thanks for that !