Training performance fluctuate #3866
Unanswered
davidshen84
asked this question in
Q&A
Replies: 1 comment
-
Here's a recording of the training. At the bottom of the frame, you can see the |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi,
I have a simple flax module. While training on my desktop with a GPU, the
tqdm
lib shows the iteration speed fluctuates between 30 it/s and 40 it/s.I wonder if it is expected that the iteration speed will fluctuate. One guess is that my CPU is not pushing data fast enough to my GPU.
Any suggestion where should I investigate?
Beta Was this translation helpful? Give feedback.
All reactions