Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

log输出中的time的意思 #687

Closed
shockjiang opened this issue May 14, 2024 · 3 comments
Closed

log输出中的time的意思 #687

shockjiang opened this issue May 14, 2024 · 3 comments

Comments

@shockjiang
Copy link

shockjiang commented May 14, 2024 •
edited

log输出：

eta: 0:00:03  time: 0.0768  data_time: 0.0137  memory: 9806

其中time & data_time 分别是什么意思？是否包含梯度回传的时间？
memory的单位是什么？

谢谢
@HIT-cwh
Copy link
Collaborator

HIT-cwh commented May 14, 2024

time表示前传 + 反传 + 参数更新（如果当前iter需要）的总时间
data_time表示读取训练数据所需时间
memory的单位是MB

@shockjiang
Copy link
Author

谢谢。
是指rank=0的GPU设备上，整个batch的时间，对吗？

@hhaAndroid
Copy link
Collaborator

谢谢。 是指rank=0的GPU设备上，整个batch的时间，对吗？

对

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@shockjiang @hhaAndroid @HIT-cwh