Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: 当选择ollama作为模型时出错 #1082

Open
2 tasks done
SeventhChat opened this issue Mar 24, 2024 · 0 comments · May be fixed by #1089
Open
2 tasks done

[Bug]: 当选择ollama作为模型时出错 #1082

SeventhChat opened this issue Mar 24, 2024 · 0 comments · May be fixed by #1089
Labels
bug Something isn't working

Comments

@SeventhChat
Copy link

这个bug是否已存在现有issue了?

  • 我确认没有已有issue,且已阅读常见问题

错误表现

无法正确调用ollama后台,ollama已安装并通过11434端口正常使用。

复现操作

  1. 正常完成部署
  2. 设置 ollama 为模型后发生错误

错误日志

2024-03-24 09:51:48,323 [INFO] [base_model.py:691] Tokens per second:10.311897622189505
Traceback (most recent call last):
  File "D:\ChuanhuChatGPT\modules\models\models.py", line 144, in get_model
    model = OllamaClient(model_name, user_name=user_name, backend_model=lora_model_path)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\ChuanhuChatGPT\modules\models\Ollama.py", line 20, in __init__
    self.update_token_limit()
  File "D:\ChuanhuChatGPT\modules\models\Ollama.py", line 27, in update_token_limit
    lower_model_name = self.backend_model.lower()
                       ^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'list' object has no attribute 'lower'

运行环境

  • OS: Windows 10 22h2
  • Browser: edge
  • Gradio version:
  • Python version: 3.11

帮助解决

  • 我愿意协助解决!

补充说明

No response

@SeventhChat SeventhChat added the bug Something isn't working label Mar 24, 2024
@tusik tusik linked a pull request Apr 1, 2024 that will close this issue
@Keldos-Li Keldos-Li linked a pull request Apr 1, 2024 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant