Skip to content

Issues: xorbitsai/inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

277 Open 463 Closed
277 Open 463 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

同一服务器下不同用户使用xinference服务时的模型识别BUG
#1511 opened May 17, 2024 by ybsbbw v0.11.1
langchain中Xinference Chat的支持 question Further information is requested
#1510 opened May 17, 2024 by buptzyf v0.11.1
docker 0.10.3 版本 3060 显卡运行 llama-3-8b-instruct-q4_k_m 发送消息后持续阻塞 gpu
#1509 opened May 16, 2024 by tzraeq v0.11.1
bce-reranker-base 模型调用报错 CUDA-capable device(s) is/are busy or unavailable gpu
#1505 opened May 16, 2024 by tevooli v0.11.1
QUESTIO目前xinference支持一个模型部署在多台机器上么？ question Further information is requested
#1504 opened May 16, 2024 by zhanghaiqiangshigezhu v0.11.1
xinference部署能使用deepspeed吗？ question Further information is requested
#1503 opened May 16, 2024 by wangyongpenga v0.11.1
5
xinference并发处理问题
#1502 opened May 15, 2024 by ccly1996 v0.11.1
1
在dify接入xinf部署的chatglm3-6b，成功使用工具后的后续对话会报错
#1497 opened May 14, 2024 by he498 v0.11.1
The accidental triggering of a KeyError exception can cause the entire service to crash. gpu
#1496 opened May 14, 2024 by yinghaodang v0.11.1
BUG
#1495 opened May 14, 2024 by insistence-essenn v0.11.1
支持关闭Metrics吗？ question Further information is requested
#1492 opened May 14, 2024 by Chen94yue v0.11.1
Error when registering model:invalid model uri question Further information is requested
#1490 opened May 14, 2024 by rudadasir v0.11.1
1
底层会支持reAct这种能力么
#1488 opened May 13, 2024 by tanyo520 v0.11.1
社区版OAuth2功能改进建议 question Further information is requested
#1487 opened May 13, 2024 by jinjinhao v0.11.1
BUG！quick exited when docker run cpu-version
#1484 opened May 13, 2024 by rudadasir v0.11.1
安装xinference卡住不动
#1483 opened May 13, 2024 by wangyongpenga v0.11.1
4
使用xinference部署模型，输出异常截断的问题 gpu
#1480 opened May 13, 2024 by ybsbbw v0.11.1
3
BUG: Could not start v0.11.0 from Docker Compose bug Something isn't working
#1478 opened May 12, 2024 by Minamiyama v0.11.1
17
多卡启动自定义模型时，报Remote server unixsocket错误 gpu question Further information is requested
#1474 opened May 11, 2024 by mrkingsun v0.11.1
自定义注册模型卡片的查看和编辑问题
#1473 opened May 11, 2024 by ConleyKong v0.11.1
支持跨主机部署模型推理
#1472 opened May 10, 2024 by lordk911 v0.11.1
5
Support spare embedding of bge-m3
#1471 opened May 10, 2024 by yefangok v0.11.1
Request Limits参数对stream=true情况下无法限制并发数 question Further information is requested
#1467 opened May 10, 2024 by gggauss v0.11.1
如何控制大模型返回结果？ question Further information is requested
#1465 opened May 9, 2024 by yinghaodang v0.11.1
1
The actor is dead because its worker process has died. Worker exit type: SYSTEM_ERROR Worker exit detail: Worker unexpectedly exits with a connection error code 2. End of file. There are some potential root causes. (1) The process is killed by SIGKILL by OOM killer due to high memory usage. (2) ray stop --force is called. (3) The worker is crashed unexpectedly due to SIGSEGV or other unexpected errors.
#1464 opened May 9, 2024 by insistence-essenn v0.11.1
2
ProTip! no:milestone will show everything without a milestone.