Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Interesting comparison between translation engines (GPT-4 beats all other translators) #1

Open
Emasoft opened this issue Mar 16, 2023 · 2 comments

Comments

@Emasoft
Copy link

Emasoft commented Mar 16, 2023

Interesting comparison between translation engines (GPT-4 beats all other translators):
https://www.reddit.com/r/ChatGPT/comments/11t389v/wow_gpt4_beats_all_the_other_translators/

@alphadl
Copy link
Collaborator

alphadl commented Mar 19, 2023

Hi Emasoft, thanks for your kind interest in our report.

Actually, our original intention is to maximize the translation performance of ChatGPT, and in this way, we give several pieces of advice in the report. Given the discussion on Reddit and the OpenAI official blog, we guess the multilingual processing ability improvement of GPT4 is mainly from the instruction tuning on the translated MMLU dataset.

Also, we sampled some test sets in our report to compare whether the proposed usage recipes could facilitate GPT4 either, and our conclusion is YES. More details will be updated in the report soon.

@alphadl
Copy link
Collaborator

alphadl commented Mar 19, 2023

Welcome to try our proposed strategies in GPT4, and any feedbacks are welcome to post here or drop us an email.
Me ([email protected]) and the first author ([email protected]).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants