Skip to content

Issues: ShannonAI/service-streamer

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

31 Open 34 Closed
31 Open 34 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

请问是否支持流式输出 Is it support stream output by GPT model?
#101 opened Sep 3, 2023 by c66w
当模型predict参数为ndarray的时候会将参数修改成list
#100 opened Jul 27, 2023 by danerlt
1
分布式问题
#99 opened May 12, 2023 by ZTurboX
Returning dictionary instead of a list in provided callback to ThreadedStreamer
#97 opened Feb 21, 2023 by cgr71ii
基于paddle训练出的模型基于steamer进行处理报错
#96 opened Dec 19, 2022 by XavierWonderful
某个worker死掉后，mp.Queue() get获取输入数据，锁无法释放bug
#94 opened Sep 5, 2022 by lxsyz
does service streamer support cpu deploy?
#93 opened Feb 11, 2022 by zhanghaoie
1
Worker_timeout
#92 opened Dec 30, 2021 by MuhammadKhalid3975
2
关于 streamer = Streamer(... cuda_devices=(0,1,2,3))时，gpu 0不被使用的问题
#91 opened Nov 11, 2021 by WuZifan
关于 (fastapi) 推理会阻塞（block）的解决方法
#90 opened Oct 31, 2021 by yangtianyu92
Is this project still active? Will a new version past 0.1.2 be published?
#89 opened Aug 12, 2021 by LeBaronDean
3
future won't be free in future_cache_ref when TimeoutError occurred
#88 opened Jul 19, 2021 by Dwan-g
1
请问如果我在服务器启动过程中想要实时修改batchsize和max latency要怎么做？
#87 opened Apr 15, 2021 by Homura2333
Detectron2 DefaultPredictor
#85 opened Feb 25, 2021 by neerajvashistha
Error on multi-threading !!!
#84 opened Feb 16, 2021 by marcusau
2
关于redis+multi_gpu
#83 opened Oct 6, 2020 by syyuan14
try add model_init_args & model_init_kwargs
#82 opened Sep 1, 2020 by yangtianyu92
2
可以配合tornado使用么?
#81 opened Aug 14, 2020 by tengmao
3
Timeout errors (with GPT2 and simple 'return' model)
#80 opened Aug 2, 2020 by m4gr4th34
7
self._task_id 问题
#78 opened Jul 14, 2020 by yongzhuo
TypeError: can't pickle _thread.RLock objects
#69 opened May 26, 2020 by c0derm4n
1
RedisStreamer如何配置batch_size&max_latency
#67 opened May 22, 2020 by c0derm4n
6
服务卡死现象
#66 opened May 14, 2020 by caseware66
3
redis.exceptions.Connectionerror: error 110 connection to localhost:1234 connection timed out
#65 opened May 13, 2020 by LiuHao-THU
3
Problem using flask_multigpu_example.py with gunicorn
#64 opened May 13, 2020 by miangangzhen
1
ProTip! no:milestone will show everything without a milestone.