Qwen2-VL-2B result for TextVQA differs from paper

[soonchangAI]

Hi, The TextVQA accuracy recorded on paper is 79.7% for Qwen2-VL-2B ( Qwen/Qwen2-VL-2B-Instruct).
However, I obtained TextVQA result of 77.576% (-2.124%)

"Overall"
"77.576"

I have followed installation instruction from #492 (comment)

[PhoenixZ810]

Hi,

Different environments, such as variations in the versions of CUDA, PyTorch, Flash-Attention, and Transformers, can indeed lead to fluctuations in the results.
Regarding the scores of 79.7 and 77.57, the difference between these two results is relatively minor and can be attributed to such environmental variations. These fluctuations are within an expected range and do not indicate a significant discrepancy.

We appreciate your understanding and are available for any further discussions or clarifications you might need.