Skip to content

Runtime error on huggingface demo #205

@anilcse

Description

@anilcse
runtime error
Exit code: 1. Reason: last):
  File "/home/user/app/app.py", line 12, in <module>
    from peft import PeftModel
  File "/home/user/.pyenv/versions/3.10.17/lib/python3.10/site-packages/peft/__init__.py", line 22, in <module>
    from .auto import (
  File "/home/user/.pyenv/versions/3.10.17/lib/python3.10/site-packages/peft/auto.py", line 31, in <module>
    from .mapping import MODEL_TYPE_TO_PEFT_MODEL_MAPPING
  File "/home/user/.pyenv/versions/3.10.17/lib/python3.10/site-packages/peft/mapping.py", line 23, in <module>
    from .peft_model import (
  File "/home/user/.pyenv/versions/3.10.17/lib/python3.10/site-packages/peft/peft_model.py", line 38, in <module>
    from .tuners import (
  File "/home/user/.pyenv/versions/3.10.17/lib/python3.10/site-packages/peft/tuners/__init__.py", line 21, in <module>
    from .lora import LoraConfig, LoraModel
  File "/home/user/.pyenv/versions/3.10.17/lib/python3.10/site-packages/peft/tuners/lora.py", line 45, in <module>
    import bitsandbytes as bnb
  File "/home/user/.pyenv/versions/3.10.17/lib/python3.10/site-packages/bitsandbytes/__init__.py", line 15, in <module>
    from .nn import modules
  File "/home/user/.pyenv/versions/3.10.17/lib/python3.10/site-packages/bitsandbytes/nn/__init__.py", line 21, in <module>
    from .triton_based_modules import (
  File "/home/user/.pyenv/versions/3.10.17/lib/python3.10/site-packages/bitsandbytes/nn/triton_based_modules.py", line 7, in <module>
    from bitsandbytes.triton.int8_matmul_mixed_dequantize import (
  File "/home/user/.pyenv/versions/3.10.17/lib/python3.10/site-packages/bitsandbytes/triton/int8_matmul_mixed_dequantize.py", line 13, in <module>
    from .matmul_perf_model import early_config_prune, estimate_matmul_time
  File "/home/user/.pyenv/versions/3.10.17/lib/python3.10/site-packages/bitsandbytes/triton/matmul_perf_model.py", line 10, in <module>
    from triton.runtime import driver
ImportError: cannot import name 'driver' from 'triton.runtime' (/home/user/.pyenv/versions/3.10.17/lib/python3.10/site-packages/triton/runtime/__init__.py)
Container logs:

Failed to retrieve error logs: SSE is not enabled

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions