Intemittent memory errors when trying to load model. #816
Answered
by
balisujohn
balisujohn
asked this question in
Q&A
-
Sometimes the model correctly loads, and sometimes it errors out with the following output. Does anyone have any idea what's going on here? output (ggml commit 98875cd):
code:
|
Beta Was this translation helpful? Give feedback.
Answered by
balisujohn
May 8, 2024
Replies: 2 comments 1 reply
-
It's weird because my gpt2 model always seems to load correctly, but when I load this model afterwards, using as far as I can tell the same loading strategy and the same file format, the load seems to non-deterministically fail. |
Beta Was this translation helpful? Give feedback.
0 replies
-
I think I fixed it lol, weird that it worked even intermittently before. If it's anything other than user error, I'll make a note of it here. |
Beta Was this translation helpful? Give feedback.
1 reply
Answer selected by
balisujohn
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I think I fixed it lol, weird that it worked even intermittently before. If it's anything other than user error, I'll make a note of it here.