Skip to content

Commit

Permalink
Merge branch 'ko3n1g/fix/gelu' into 'main'
Browse files Browse the repository at this point in the history
fix: GeLUFunction

See merge request ADLR/megatron-lm!1993
  • Loading branch information
ericharper committed Aug 29, 2024
2 parents 50b073c + f61d22c commit b76a7d3
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion megatron/core/fusions/fused_bias_gelu.py
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ def backward(ctx, grad_output):
# This is required to make Sphinx happy :-(
@classmethod
def apply(cls, *args, **kwargs):
super().apply(*args, **kwargs)
return super().apply(*args, **kwargs)


bias_gelu_impl = GeLUFunction.apply

0 comments on commit b76a7d3

Please sign in to comment.