Skip to content

Pull requests: Lightning-AI/litgpt

New pull request New
25 Open 759 Closed
25 Open 759 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Adds streaming option to generate
enhancement New feature or request
#1424 opened May 16, 2024 by rasbt Loading…
1
10
WIP: TensorParallel with new strategy
#1421 opened May 14, 2024 by awaelchli • Draft
Thunder FSDP as a regular transform
#1415 opened May 13, 2024 by carmocca • Draft
@carmocca
OptimizerArgs
breaking change
#1409 opened May 10, 2024 by rasbt • Draft
22 tasks
5
Add prompt style mapping for llama3
#1406 opened May 9, 2024 by davmacario Loading…
@awaelchli
Fix issues with LitGPT Tokenizer (SentencePiece and HF Tokenizers)
#1396 opened May 7, 2024 by Andrei-Aksionov • Draft
Option to skip expensive final validation
#1372 opened Apr 29, 2024 by rasbt Loading…
6
Add resume for adapter_v2, enable continued finetuning for adapter
#1354 opened Apr 25, 2024 by altria-zewei-wang Loading…
3
Add LongLora for both full and lora fine-tuning
#1350 opened Apr 24, 2024 by belerico Loading…
16
Add phi-3 checkpoint
#1341 opened Apr 23, 2024 by rasbt • Draft
7 tasks
14
example for full finetuning with python code done!
#1331 opened Apr 21, 2024 by shatz01 Loading…
Correct an apparent logger output directory bug
#1232 opened Apr 2, 2024 by yutsai84 Loading…
4
Introduce OptimizerArgs and add support for GaLore
breaking change
#1192 opened Mar 25, 2024 by rasbt Loading…
14 of 15 tasks
1
16
Config URLs for pinned version
#1182 opened Mar 23, 2024 by awaelchli • Draft
1
1
Improved Lora finetuning script
#1179 opened Mar 22, 2024 by pattplatt Loading…
12
Separate out the biases
#1156 opened Mar 18, 2024 by rasbt Loading…
9
[WIP] Simplified preparation of pretraining datasets
enhancement New feature or request
#1057 opened Mar 7, 2024 by awaelchli • Draft
1
Drop interleave placement in QKV matrix
breaking change
#1013 opened Mar 5, 2024 by Andrei-Aksionov Loading…
9
[WIP] Add OLMo
checkpoints
#927 opened Feb 12, 2024 by rasbt Loading…
5 of 14 tasks
1
10
AutoGPTQ integration
quantization
#924 opened Feb 12, 2024 by Andrei-Aksionov Loading…
[feat] support 01-ai Yi-6B/34B
#899 opened Jan 24, 2024 by metame-none Loading…
1
Adds batched inference with left-padding
#886 opened Jan 17, 2024 by FlimFlamm Loading…
15
Add Qwen support
enhancement New feature or request
#850 opened Dec 29, 2023 by chenht2026 • Draft
1
11
LoRA: dequantize model
#811 opened Dec 14, 2023 by Andrei-Aksionov • Draft
WIP/Add: NEFTune to Lit-GPT
#653 opened Oct 18, 2023 by nkasmanoff • Draft
ProTip! Add no:assignee to see everything that’s not assigned.