Limiting communication bandwidth

[wutianyuan1]

Hi,

I wonder if there is a way to manully limit the communication bandwidth between two GPUs? For example, I want to set the upper bound bandwidth between GPU1 and GPU3 to be 300Mbps (just like using nvidia-smi -lgc to lock clock rates). So is there such tools to achieve this? Thanks a lot!

[deepakcu]

How are the GPUs connected? If they are connected with nvlink, see options for disablement here:
https://github.com/NVIDIA/open-gpu-kernel-modules/blob/550.76/src/nvidia/interface/nvrm_registry.h#L1528-L1539

Foe example try:
sudo modprobe nvidia NVreg_RMNvLinkDisableLinks=0x1 should disable the 0th nvlink.