Support for GPU's on Rancher-Desktop (MAC)

[donovat]

Problem Description

Request investigation and documentation into supporting GPU's by Rancher-desktop.
It would be great if the Rancher-desktop documentation included help and advice in supporting GPU's on both MAC's (M!) and I expect Windows. - i.e. Do we need to follow the NVIDIA toolkit suggestions for installing with docker? or the suggestion for installing with kubernetes?

GPU support will become an increasing requirement for many applications, especially those using Machine Learning, and python tool kits like Cuda etc.

Proposed Solution

Documentation examples, FAQ's etc .. in supporting GPU's by Rancher Desktop.

Additional Information

No response

[donovat]

ps. Can see that this issue would be linked to CUDA support (WSL) #3968

[jandubois]

advice in supporting GPU's on both MAC's (M!)

I'm curious how you could utilize the Apple GPUs from a Linux VM. Are there any tools/libraries that would use them?

[donovat]

Hi @jandubois - in truth I am not sure if you can or cannot. However, some one way have already looked into this problem, and could thus include info into this issue. Either way a doc/FAQ update would help people know the current state of play.

[okamototk]

@jandubois
Podman already support Mac GPU in container. They use krunkit for VMM to boot virtual machine.
krunkit convert Metal API to Vaulkan API and we can use GPU though Vulkan API on Linux.

This diagram explan well about architecture.

But mostry you may use krunkit instead of lima for Mac.

[jandubois]

But mostly you may use krunkit instead of lima for Mac.

@okamototk Thank you for your suggestion. I don't see us replacing Lima for macOS (or Linux) right now.

I think it would be more likely that Lima could implement a krunkit driver instead, giving you a choice between qemu, vz, and krunkit on macOS. So I would recommend filing an enhancement request on Lima instead.

[nirs]

@okamototk you can try minikub krunkit driver from this pr:
kubernetes/minikube#20826