Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Target 10 out of bounds while training on complete dataset #226

Open
parthkvv opened this issue Jun 4, 2022 · 1 comment
Open

Target 10 out of bounds while training on complete dataset #226

parthkvv opened this issue Jun 4, 2022 · 1 comment

Comments

@parthkvv
Copy link

parthkvv commented Jun 4, 2022

I am training my own dataset with 2 classes. Got error : "CUDA error: device-side assert triggered." When I tried to run with CPU, got the error : "IndexError: Target 10 is out of bounds".
Running the model on a much smaller sample of my data works perfectly fine, the error only pops up when I try to train it on my complete data.
(during training, batch size : 4 )
input image shape : torch.Size([4, 3, 513, 513])
target shape : torch.Size([4, 513, 513])
output shape : torch.Size([4, 2, 513, 513])

Tried changing batch size and and the number of workers in arguments, but no use.
@jfzhang95 Can you suggest anything based upon this?

@chiba1sonny
Copy link

The same problem.
Have you solved it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants