Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug]: Ollama temperature parameter bug #423

Closed
1 task done
henryclw opened this issue May 25, 2024 · 1 comment
Closed
1 task done

[Bug]: Ollama temperature parameter bug #423

henryclw opened this issue May 25, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@henryclw
Copy link

What happened?

I was using remote ollama as backend. And when I changed the temperature to zero, I could still get different output every time.

Version check

  • Yes I was.

Relevant log output

No response

Relevant screenshots (optional)

No response
@henryclw henryclw added the bug Something isn't working label May 25, 2024
@henryclw henryclw mentioned this issue May 25, 2024
Closed
@RodriMora
Copy link

I believe Ollama uses GGUF quants, and even with temperature at 0 they are not fully deterministic

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Pass the temperature and top p parameters to ollama backend correctly henryclw/fabric
3 participants
@danielmiessler @RodriMora @henryclw