-
Notifications
You must be signed in to change notification settings - Fork 215
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Sudden Increase in Loss value while finetuning #173
Comments
nikithakriz
changed the title
Sudden Hike in Loss value while finetuning
Sudden Incerase in Loss value while finetuning
Apr 10, 2023
nikithakriz
changed the title
Sudden Incerase in Loss value while finetuning
Sudden Increase in Loss value while finetuning
Apr 10, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I am finetuning tapas in custom dataset. After creating the dataset while training there is an sudden increase in loss value. After debugging i understood that some of the files creating this issue. But i didn't get the exact logic behind the issue and why that files creating the issue. They are more common like other files. After removing this files from teh dataset the training started with normal loss value.
Issue in Loss Value:
Epoch: 0
Loss: 9963.3525390625
The text was updated successfully, but these errors were encountered: