Skip to content

failed to convert glm-edge-v-5b to intel openvino model #14

@zutuanwang

Description

@zutuanwang

System Info / 系統信息

glm-edge-v-5b, dowload from model.cn

Who can help? / 谁可以帮助到您?

No response

Information / 问题信息

  • The official example scripts / 官方的示例脚本
  • My own modified scripts / 我自己修改的脚本和任务

Reproduction / 复现过程

failed to convert glm-edge-v-5b to intel openvino model:
python convert.py --model_id C:/Users/xxx/.cache/modelscope/hub/ZhipuAI/glm-edge-v-5b --output D:/LLM/glm-edge.openvino/model/glm-edge-v-5b-ov
INFO:nncf:NNCF initialized successfully. Supported frameworks detected: torch, onnx, openvino ⌛ glm-edge-v-5b conversion started. Be patient, it may takes some time. ⌛ Load Original model INFO:nncf:NNCF initialized successfully. Supported frameworks detected: torch, onnx, openvino Loading checkpoint shards: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:07<00:00, 3.88s/it] ✅ Original model successfully loaded ⌛ Convert Language model Traceback (most recent call last): File "D:\LLM\glm-edge.openvino\glm-edge-v\convert.py", line 49, in <module> convert_glmv_model(model_path, ir_model_path, compression_configuration) File "D:\LLM\glm-edge.openvino\glm-edge-v\glmv_helper.py", line 319, in convert_glmv_model pkv = model.model( ^^^^^^^^^^^^ File "C:\Users\xxx\.conda\envs\glm-edge-openvino\Lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl return self._call_impl(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\xxx\.conda\envs\glm-edge-openvino\Lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl return forward_call(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\xxx\.cache\huggingface\modules\transformers_modules\glm-edge-v-5b\modeling_glm.py", line 775, in forward imgs = torch.unsqueeze(images[0], 0) ~~~~~~^^^ TypeError: 'NoneType' object is not subscriptable

Expected behavior / 期待表现

succeed to convert glm-edge-v-5b to intel openvino model

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions