Adapt to fewer GPUs

[haoyangliu123]

Dear Support teams,
Thanks for your great job! When I train the model, I set the visible Cuda to be 4. However, the code gets stuck before the training begins. I wonder how we can adapt the training on fewer GPUs.

Best wishes