-
Notifications
You must be signed in to change notification settings - Fork 190
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
输出日志里的loss计算 #106
Comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
在trainer.py中,在backward结束后,为了输出loss会对total_loss做一个all_reduce的操作,但是并未对crf_loss和gl_loss做all_reduce的操作,为什么在后面gl_loss/=size,crf_loss/=size。我理解的难道是因为在对total_loss做all_reduce时,crf_loss和gl_loss也会做相应的改变吗?希望您可以解释一下,谢谢~
The text was updated successfully, but these errors were encountered: