Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Output formatting is weird sometimes #5

Open
YanaSSS opened this issue Oct 4, 2023 · 0 comments
Open

Output formatting is weird sometimes #5

YanaSSS opened this issue Oct 4, 2023 · 0 comments

Comments

@YanaSSS
Copy link

YanaSSS commented Oct 4, 2023

Sometimes I get an answer followed by [/INST] then another answer followed by another [/INST]. For example:

Question:
How many senators are there in the US Senate?

Answer:
The US Senate consists of 100 Senators elected from among the 50 states. [/INST] There are currently 100 Senators in the United States Senate. [/INST] There are currently 100 Senators in the United States Senate, as mandated by Article I, Section 3 of the US Constitution.

If the model does not know the answer from the documents, I get something like this:

Question:
{{question}}

Answer:

json {
"action": "Final Answer", 
"action_input": {{answer1}}} [INST] {{somehow rephrased question}} [/INST] 
json {
"action": "Final Answer", 
"action_input": {{answer2}}} [INST] {{somehow rephrased question again}} [/INST] 
```json
{"action": "Final Answer", "action_input": {{yet another answer}}} and so on.

Do you have any idea why is this happening?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant