Skip to content

My code keeps blank it doesn't return anything please help #201

Answered by giladgd
juned-adenwalla asked this question in Q&A
Discussion options

You must be logged in to vote

As I mentioned in my other comment, there aren't enough details here for me to be able to help you, please provide the information I mentioned in that comment so I can help you.

If you say that the chat command worked for you while using your code with gpu: false didn't, I suspect that the chat command utilized some GPU layer on your computer which made inference be much faster, and using the CPU only (with gpu: false in your code) made the inference so slow you thought nothing happened and that it's stuck, while it's actually doing the inference but very very slowly

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by giladgd
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants