Skip to content

Issues: princeton-nlp/LLM-Shearing

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

19 Open 49 Closed
19 Open 49 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Open source the pruning mask.
#70 opened May 2, 2024 by Achazwl
Support for Llama-3 / GQA?
#69 opened Apr 23, 2024 by LorrinWWW
Can LLM-Shearing be used on ViT models?
#68 opened Apr 22, 2024 by n9s8a
about shearing params config
#67 opened Apr 19, 2024 by LoverLost
Why the rope params are ignored while converting hf checkpoint to composer checkpoint?
#66 opened Mar 22, 2024 by ZhiYuanZeng
3
The dtype of tokenized data should be uint32
#65 opened Mar 20, 2024 by ZhiYuanZeng
composer model trans to pythia problem
#64 opened Mar 19, 2024 by rzr002
The Project is not implemented for 70B llama?
#62 opened Mar 8, 2024 by zhangzhenyu13
7
Start training but only output config information
#61 opened Mar 2, 2024 by Beatlesso
3
save model meet problem
#56 opened Feb 23, 2024 by 18140663659
1
TypeError: buffer is too small for requested array
#54 opened Feb 21, 2024 by 18140663659
Could you provide tokenized continue-pretraining dataset for reproduction?
#51 opened Jan 23, 2024 by gywlssww
2
KeyError: 'state'
#49 opened Jan 22, 2024 by changheecho
2
Avoid OOM using deepspeed zero-stage
#47 opened Jan 16, 2024 by gywlssww
3
在进行Building trainer时，训练会卡住；
#46 opened Jan 11, 2024 by coderchem
1
model.prune_params() NotImplementedError: Could not run 'aten::nonzero'
#43 opened Dec 25, 2023 by YanxiZSQ
3
The implementation of dynamic batch loading code seems inconsistent with the pseudo-code in the paper
#42 opened Dec 25, 2023 by YWMditto
1
LanguageCrossEntropy logs nan when bash pruning.sh
#34 opened Dec 6, 2023 by YanxiZSQ
6
Pruning crash at iteration 592.
#32 opened Dec 6, 2023 by lippman1125
6
ProTip! Find all open issues with in progress development work with linked:pr.