the output for Q4_gguf is strange again!!

[milktea888]

Current Behavior

the output of Q4 model is very strange.

And I see there was ever such a bug, in #77 and also I see you have given a solution in commit id 79986ec which I switched to run is good, but it is strange again in the newest version, may I know what have you changed? And can you give me some advice on this problem? And the commit id I use is 61cac9b

And now I found that if I build the program using only cpu, the output will be ok. That is, if I build it using GPU, the output will be strange.

[bingo787]

I meet this issue too!