Skip to content

Pull requests: vllm-project/vllm

New pull request New
226 Open 1,639 Closed
226 Open 1,639 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[WIP] Support long context lora
#4787 opened May 13, 2024 by rkooo567 Loading…
[Kernel] add bfloat16 support for gptq kernel
#4781 opened May 13, 2024 by jinzhen-lin Loading…
[Misc] Separate 'dtype' out as a parameter
#4778 opened May 13, 2024 by AllenDou Loading…
2
support QLoRA
#4776 opened May 12, 2024 by chenqianfzh Loading…
1
[core] SequenceController in SamplingParams
#4775 opened May 12, 2024 by mmoskal • Draft
Sync huggingface modifications of qwen Moe model
#4774 opened May 12, 2024 by eigen2017 Loading…
1
[CI/Build] Platform agnostic wheel
#4773 opened May 12, 2024 by tomeras91 Loading…
2
[Misc] Logits processor plugins
#4769 opened May 11, 2024 by NadavShmayo Loading…
@rkooo567
[Kernel] sliding window support in paged_attention_v1/v2 kernels
#4768 opened May 11, 2024 by mmoskal • Draft
2
[Bugfix] Fix call to init_logger in openai server
#4765 opened May 11, 2024 by NadavShmayo Loading…
[Core][Bugfix]: fix prefix caching for blockv2
#4764 opened May 11, 2024 by leiwen83 Loading…
1
[CI/Build] Enable entrypoints tests to be run in a single command
#4759 opened May 11, 2024 by DarkLight1337 Loading…
[Frontend] Re-enable custom roles in Chat Completions API
#4758 opened May 11, 2024 by DarkLight1337 Loading…
1
[Core][Distributed] add fast broadcast for tensor dict
#4757 opened May 11, 2024 by youkaichao Loading…
1 task
@rkooo567
3
Support fp8 KV cache in context_attention_fwd
#4753 opened May 10, 2024 by Yard1 • Draft
Add TensorizerArgs to client api server
#4752 opened May 10, 2024 by vrdn-23 Loading…
3
[Misc] Enhance attention selector
#4751 opened May 10, 2024 by WoosukKwon Loading…
[Kernel] Add w8a8 CUTLASS kernels
#4749 opened May 10, 2024 by tlrmchlsmth • Draft
1
[CI/Build] use setuptools-scm to set __version__
#4738 opened May 10, 2024 by dtrifiro Loading…
1
[Speculative decoding] Improve n-gram efficiency
#4724 opened May 9, 2024 by comaniac Loading…
25
[CI/Build] Enforce style for C++ and CUDA code with clang-format
#4722 opened May 9, 2024 by mgoin Loading…
@rkooo567
3
[Misc] Added devcontainer to help vscode dev setup
#4720 opened May 9, 2024 by ElefHead Loading…
add TypeLogitsProcessor
#4712 opened May 9, 2024 by eitanturok • Draft
[Doc] Add API reference for offline inference
#4710 opened May 9, 2024 by DarkLight1337 Loading…
1
2
[Core][Hash][Automatic Prefix caching] Accelerating the hashing function by avoiding deep copies
#4696 opened May 8, 2024 by KuntaiDu Loading…
21
ProTip! Adding no:label will show everything without a label.