Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PROBLEM] Typo in Getting_Started_with_OpenAI_Evals.ipynb #1658

Open
yangmarcyang opened this issue Jan 31, 2025 · 0 comments · May be fixed by #1659
Open

[PROBLEM] Typo in Getting_Started_with_OpenAI_Evals.ipynb #1658

yangmarcyang opened this issue Jan 31, 2025 · 0 comments · May be fixed by #1659
Labels
bug Something isn't working

Comments

@yangmarcyang
Copy link

[optional format]

Identify the file to be fixed
examples/evaluation/Getting_Started_with_OpenAI_Evals.ipynb

Describe the problem
According to the dataset format right above, and to be consistent with the example output of the synthetic data, it seems the role is supposed to be user instead of system in {"role": "system", "content": "Q: how many car makers are their in germany"}.

Describe a solution
Change the role to user in {"role": "system", "content": "Q: how many car makers are their in germany"}

Feel free to close this issue if no fix is needed.

@yangmarcyang yangmarcyang added the bug Something isn't working label Jan 31, 2025
@yangmarcyang yangmarcyang linked a pull request Jan 31, 2025 that will close this issue
8 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant