Padding Side Option Missing in Qwen2_5_VL #830
Description
I am trying to evaluate Qwen2_5_VL on MathVista to reproduce results closer to what Qwen team report. I am seeing padding_side being right by default and can give bad results. I did evaluate earlier directly from MathVista Github repo based code and saw similar warning which ended in bad results but passing left padding in tokenizer fixed and got closer to 64% reported for Qwen2_5_VL_7B_Instruct
Upon investigating Qwen files in lmms-eval repo I can see qwen_vl version had default padding option of left but
qwen2_5_vl doesn't have option only to update from command line. Before making any PR I wanted to check if I am missing some trick to fix this or we should change this behaviour via PR
