Skip to content

Refactor GPUModelRunnerBase load_model method to include device param#13037

Merged
youkaichao merged 1 commit intovllm-project:mainfrom Zzhiter:fix_memory_profiler_in_multiGPU_envFeb 19, 2025