This is the implementation of the paper "Automatic Essay Scoring Systems Are Both Overstable And Oversensitive: Explaining Why And Proposing Defenses". Link: https://arxiv.org/abs/2109.11728
PREREQUISITES:
SKIPFLOW MODELS: https://drive.google.com/drive/folders/1igJqUXjUnQlnMvWCniZjMcIqtQmkN8qH?usp=sharing
IG RESULTS FOLDER(PRETRAINED MEM NET & BERT MODELS, DATA, and RESULTS): https://drive.google.com/drive/folders/1YJ5I6Jw4XftAU6pcpDYpMskIr1_00Uuq?usp=sharing
FINETUNED GPT MODEL: https://drive.google.com/drive/folders/1sKOGyI1-1YUB3qcBgv3-E4AHxLjFJ-Aw?usp=sharing
If you use this code, please cite the following paper: Singla, Yaman Kumar, et al. "AES Systems Are Both Overstable And Oversensitive: Explaining Why And Proposing Defenses." arXiv preprint arXiv:2109.11728 (2021).