[BUG] ValueError: Error from parse_expr with transformed code: '６'

[Leawnn]

when I use lighteval vllm to evaluate Math-500，get the error like this

The script I'm using is provided below:

export VLLM_WORKER_MULTIPROC_METHOD=spawn
MODEL=Qwen_model/Qwen2.5-Math-1.5B-Instruct
MODEL_ARGS="pretrained=$MODEL,dtype=bfloat16,max_model_length=4096,gpu_memory_utilisation=0.8,tensor_parallel_size=2"
OUTPUT_DIR=data/evals/$MODEL
# AIME 2024
TASK=aime24
lighteval vllm $MODEL_ARGS "custom|$TASK|0|0" \
    --custom-tasks src/open_r1/evaluate.py \
    --use-chat-template \
    --output-dir data/evals/$TASK

# # MATH-500
TASK=math_500
lighteval vllm $MODEL_ARGS "custom|$TASK|0|0" \
    --custom-tasks src/open_r1/evaluate.py \
    --use-chat-template \
    --output-dir data/evals/$TASK

# GPQA Diamond
TASK=gpqa:diamond
lighteval vllm $MODEL_ARGS "custom|$TASK|0|0" \
    --custom-tasks src/open_r1/evaluate.py \
    --use-chat-template \
    --output-dir data/evals/$TASK

Thanks for looking into this issue.