Skip to content

Issues: NVIDIA/TransformerEngine

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

95 Open 126 Closed
95 Open 126 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Can't find nvToolsExt during build
#879 opened May 29, 2024 by kvablack
import transformer_engine initializes CUDA bug Something isn't working
#872 opened May 28, 2024 by szmigacz
1
Strange behavior when import torch after import te. bug Something isn't working
#871 opened May 27, 2024 by GGGGGGXY
1
Release GIL when calling C extensions enhancement New feature or request
#868 opened May 24, 2024 by szmigacz
@timmoon10
Port down up may cause hang when using TE in training.
#866 opened May 24, 2024 by holmes313
Cannot import and use transformer_engine after successful installation with No module named 'transformer_engine_extensions' bug Something isn't working build Build system
#856 opened May 18, 2024 by sam-h-bean
2
inv_freq of RotaryPositionEmbedding is hard-coded to 10k
#849 opened May 15, 2024 by shijie-wu
@sudhakarsingh27
1
FP8 not converging during Supervised Fine-Tuning (though BF16 is) bug Something isn't working needinfo
#841 opened May 11, 2024 by ThomasKluiters
1
Training the 1B model on H800 resulted in a decrease in throughput performance
#836 opened May 7, 2024 by forevergj
@timmoon10
3
MLP without LayerNorm enhancement New feature or request
#817 opened Apr 26, 2024 by sriniiyer
Some doubts about the usage of DelayedScaling.interval.
#805 opened Apr 24, 2024 by wzzju
@ksivaman
[ERROR] cannot install the package, bug Something isn't working build Build system
#803 opened Apr 23, 2024 by xju2
@ksivaman
4
Request for Adaptive Layer Norm MLP enhancement New feature or request
#789 opened Apr 17, 2024 by fordflip
7
When ub_overlap_rs_dgrad is set to True, the error "Caught signal 8 (Floating point exception: integer divide by zero)" is raised. bug Something isn't working
#788 opened Apr 17, 2024 by JJGSBGQ
1
Output scale not being used with te_gemm in FP8 question Further information is requested
#778 opened Apr 14, 2024 by snarayan21
3
Replacing nn.Linear w/ te.Linear FP8 convergence issue
#764 opened Apr 9, 2024 by viclzhu
@ptrendx
9
Could TransformerEngine work with Deepspeed Zero w/ offloading? question Further information is requested
#762 opened Apr 9, 2024 by leiwen83
CPU Overhead of te.Linear FP8 Layers performance
#761 opened Apr 9, 2024 by tohinz
7
With using the fp8, after the interruption of training, and then continue , there may be a little difference in loss. Is this caused by the fp8 mechanism? question Further information is requested
#759 opened Apr 8, 2024 by zte-tcb
1
The package name passed to find_package_handle_standard_args (LIBRARY) does not match the name of the calling package (CUDNN) bug Something isn't working build Build system
#752 opened Apr 5, 2024 by shanepeckham
2
When using Import Transformer_engine, many processes will be created enhancement New feature or request
#751 opened Apr 5, 2024 by zte-tcb
[Question] Why Tensor parallel communication/GEMM overlap can happen only when sequence parallelism is enabled? enhancement New feature or request
#746 opened Apr 3, 2024 by hxdtest
1
wath's the benefit of using comm_gemm_overlap.h:bulk_overlap question Further information is requested
#742 opened Apr 1, 2024 by huxiao0
Support for overlapping tensor-parallel collectives with matmuls in fprop? enhancement New feature or request
#737 opened Mar 27, 2024 by cbcase
2
Best out of the box framework for training a BitNet model question Further information is requested
#723 opened Mar 15, 2024 by RonanKMcGovern
ProTip! Find all open issues with in progress development work with linked:pr.