Shouldn't prompt formats be an enumerator? #6335
Answered
by
ggerganov
danemadsen
asked this question in
Q&A
-
Hi i was looking into the code for gpt_params and I'm wondering why there's a boolean property for each prompt format (currently just Shouldn't this just be a single enumerator property named something like
|
Beta Was this translation helpful? Give feedback.
Answered by
ggerganov
Mar 27, 2024
Replies: 1 comment
-
These parameters are old "hacks" - should be removed and replaced with |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
danemadsen
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
These parameters are old "hacks" - should be removed and replaced with
llama_chat_apply_template()
in order to use the correct chat template that comes with the model