Code

feat: add mps support#22

Code

Open

Fodark wants to merge 5 commits intodeepseek-ai:maindeepseek-ai/DeepSeek-VL:mainfrom Fodark:mps-supportFodark/DeepSeek-VL:mps-supportCopy head branch name to clipboard

+49-11

Commits

Commits on Mar 13, 2024

• automatically detect the Python version, if above 3.10 patch collections to use collections.abc

  Fodark

  committed
  c99e9f1

  Copy full SHA for c99e9f1

• use transformers 4.38.1 instead of 4.38.2 as autocast fails on mps on latest version

  Fodark

  committed
  5db8156

  Copy full SHA for 5db8156

• add an util function to detect platflorm and suitable dtype

  Fodark

  committed
  494e622

  Copy full SHA for 494e622

• load model on detected device and use correct dtype

  Fodark

  committed
  40ec649

  Copy full SHA for 40ec649

• modify example in README to use the new device and dtype function

  Fodark

  committed
  4eac5b5

  Copy full SHA for 4eac5b5