Skip to content

Releases: signcl/vllm

0.2.6.carbon

08 Mar 09:24
@Uhao-P Uhao-P
0.2.6.carbon
f650cb7
Compare
Choose a tag to compare
0.2.6.carbon Latest
Latest

基于vllm的0.2.2版本集成carbon

Assets 3

0.2.2.carbon

05 Jan 12:38
@Uhao-P Uhao-P
0.2.2.carbon
bbe4466
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
0.2.2.carbon
  • 基于vllm的0.2.2版本集成carbon
  • 目前量化推理功能未测试
  • 注意：
  1. 此版本的vllm量化不支持tp
  2. 此次target并不是mian而是官方0.2.2的tag
Assets 3