Skip to content

Commit 5fac72d

Browse files
Update README.md
1 parent 5c14bcc commit 5fac72d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Llama meets EU: Investigating the European Political Spectrum through the Lens of LLMs
22

3-
Instruction-finetuned Large Language Models inherit clear political leanings that have been shown to influence downstream task performance. In this work ([Chalkidis and Brandl, 2024](https://arxiv.org/abs/2403.13592)), we expand this line of research beyond the two-party system in the US and audit *Llama Chat* on political debates from the European Parliament in various settings to analyze the model's political knowledge and its ability to reason in context. We adapt, i.e., further fine-tune, *Llama Chat* on parliamentary debates of individual euro parties to reevaluate its political leaning based on the \euandi questionnaire. *Llama Chat* shows extensive prior knowledge of party positions and is capable of reasoning in context. The adapted, party-specific, models are substantially re-aligned towards respective positions which we see as a starting point for using chat-based LLMs as data-driven conversational engines to assist research in political science.
3+
Instruction-finetuned Large Language Models inherit clear political leanings that have been shown to influence downstream task performance. In this work ([Chalkidis and Brandl, 2024](https://arxiv.org/abs/2403.13592)), we expand this line of research beyond the two-party system in the US and audit *Llama Chat* ([Touvron et al., 2023](https://arxiv.org/abs/2307.09288)) on political debates from the European Parliament in various settings to analyze the model's political knowledge and its ability to reason in context. We adapt, i.e., further fine-tune, *Llama Chat* on parliamentary debates of individual euro parties to reevaluate its political leaning based on the *EU-AND-I* questionnaire ([Michel et al., 2019](https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3446677)). *Llama Chat* shows extensive prior knowledge of party positions and is capable of reasoning in context. The adapted, party-specific, models are substantially re-aligned towards respective positions which we see as a starting point for using chat-based LLMs as data-driven conversational engines to assist research in political science.
44

55
![Radar Plots](https://i.ibb.co/28Ptc37/Screenshot-2024-05-22-at-10-59-26.png)
66

0 commit comments

Comments
 (0)