Skip to content

Pull requests: HabanaAI/vllm-fork

New pull request New
Clear current search query, filters, and sorts
61 Open 835 Closed
61 Open 835 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[PoC] Add max padding ratio to padding aware scheduler habana Issues or PRs submitted by Habana Labs
#407 opened Oct 18, 2024 by kzawora-intel • Draft
Add models-tiny CI step with Llama3.2-1B habana Issues or PRs submitted by Habana Labs
#440 opened Oct 28, 2024 by kzawora-intel • Draft
[WIP] Add HPU support to vLLM v1
#487 opened Nov 12, 2024 by kzawora-intel • Draft
19 of 23 tasks
1
Multi models support for upstream
#590 opened Dec 4, 2024 by xuechendi • Draft
1
Add in Dockerfile.hpu.ubi external Issues or PRs submitted by external users
#602 opened Dec 9, 2024 by Xaenalt Loading…
13
[WIP] Add HPU support to vLLM v1 - cont. stale
#609 opened Dec 10, 2024 by kzawora-intel Loading…
21 of 23 tasks
1
Add exponential bucketing integration
#642 opened Dec 17, 2024 by kzawora-intel Loading…
1
Chunked Prefill
#656 opened Dec 20, 2024 by hlahkar • Draft
18
add renormalize param for FusedMOE
#671 opened Jan 9, 2025 by tangleintel • Draft
4
Enabled and optimized GLM-4v-9b on Gaudi New Model Issue o PR to enable a new model
#691 opened Jan 16, 2025 by gyou2021 Loading…
15
make benchmark_throughput static support single image input
#718 opened Jan 22, 2025 by yma11 • Draft
11
Pipeline Parallelism implementation.
#731 opened Jan 23, 2025 by jmaksymczuk • Draft
6
[DO NOT MERGE][PoC] Mark dynamic shapes in torch.compile mode
#755 opened Jan 29, 2025 by kzawora-intel • Draft
1
Enable roberta embedding
#786 opened Feb 5, 2025 by yeonsily Loading…
14
[DEEPSEEK_V3/R1] includes features of fp8 dequant, MLA, Expert parallelism
#792 opened Feb 6, 2025 by xuechendi Loading…
7
Support qwenvl model for HPU New Model Issue o PR to enable a new model
#793 opened Feb 7, 2025 by yingjie-han Loading…
9
Update documentation to reflect current bucket defaults
#817 opened Feb 12, 2025 by nngokhale Loading…
5
enable LoRA for embedding models
#821 opened Feb 12, 2025 by skaulintel • Draft
3
Resolve Speculative Decode RTE
#823 opened Feb 13, 2025 by tannervoas742 Loading…
4
Extend accuracy tests for models that we support
#824 opened Feb 13, 2025 by AnetaKaczynska Loading…
11
enable multi-modal embedding for TIGER-Lab/VLM2Vec-Full T+I on HPU
#854 opened Feb 20, 2025 by libinta Loading…
3
Update requirements-hpu.txt for open telemetry tracing support
#857 opened Feb 21, 2025 by louie-tsai Loading…
5
[CI] Add APC tests
#866 opened Feb 25, 2025 by kzawora-intel Loading…
[DO NOT MERGE] Add possibility to execute with LoRA adapter for lm_eval
#879 opened Feb 28, 2025 by mkrze • Draft
Bump jinja2 from 3.1.4 to 3.1.6 dependencies Pull requests that update a dependency file python Pull requests that update python code
#891 opened Mar 6, 2025 by dependabot bot Loading…
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.