Skip to content

Pull requests: EricLBuehler/mistral.rs

New pull request New
48 Open 781 Closed
48 Open 781 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

adapt to rig crate as client
#1214 opened Mar 16, 2025 by benliao Loading…
1
Multimodal prefix caching
#1209 opened Mar 14, 2025 by EricLBuehler Loading…
1
Refactor multiproc TP impl
#1180 opened Mar 9, 2025 by EricLBuehler Loading…
1
FlashMLA support
#1159 opened Feb 25, 2025 by EricLBuehler Loading…
1
Add a MISTRALRS_NO_CUBLASLT env var
#1151 opened Feb 16, 2025 by EricLBuehler Loading…
1
MPI support for multi-node
#1133 opened Feb 12, 2025 by EricLBuehler Loading…
1
I-quant support (IQ4_XS, etc)
#1120 opened Feb 3, 2025 by EricLBuehler Loading…
1
MiniCPM-O 2.6 audio support
#1089 opened Jan 23, 2025 by EricLBuehler Loading…
5
Add an easy cli
#1087 opened Jan 23, 2025 by EricLBuehler • Draft
1
Move supports_attn_softmax logic to build.rs
#1085 opened Jan 23, 2025 by EricLBuehler • Draft
5
paged-attn:cuda fallback bf16 for compute_cap < 8.0
#1040 opened Jan 8, 2025 by haricot • Draft
1
Refactor transformer implementations, unifying common components
#1030 opened Jan 6, 2025 by p-e-w • Draft
1
#1008: Working <|image|> injection
#1015 opened Dec 30, 2024 by bioshazard Loading…
1
KV Cache Quantization new feature New feature or request
#988 opened Dec 11, 2024 by EricLBuehler Loading…
4 of 7 tasks
1
Add BNB cuda gemv 4bit kernels
#970 opened Dec 4, 2024 by EricLBuehler Loading…
1
Bitsandbytes quantization ISQ support
#968 opened Dec 4, 2024 by EricLBuehler Loading…
1
Add Phi 3.5 MoE, Mixtral support for UQFF
#855 opened Oct 16, 2024 by EricLBuehler Loading…
1
Add a stresstest example
#844 opened Oct 12, 2024 by EricLBuehler Loading…
1
ADDED :- Badges in Readme
#840 opened Oct 11, 2024 by Ruhi14 Loading…
2
Docs update
#837 opened Oct 10, 2024 by FarukhS52 Loading…
1
Update README.md
#826 opened Oct 5, 2024 by kushal34712 Loading…
2
Update README.md
#825 opened Oct 5, 2024 by kushal34712 Loading…
1
Add ISQ support for FLUX
#817 opened Oct 2, 2024 by EricLBuehler Loading…
2
Integrate KBNF grammar
#815 opened Oct 2, 2024 by EricLBuehler Loading…
15
Return stop reason enum in responses breaking
#802 opened Sep 28, 2024 by EricLBuehler Loading…
1
ProTip! Adding no:label will show everything without a label.