[FT] Why not use math_verify as a direct dependency?

[jiangwangyi]

Hi team,

I noticed that the mathematical parsing and verification functions in lighteval appear to be a vendored (copied) version of the Math-Verify package.

Manual syncs, like the one in PR #535, seem to confirm this.

To simplify maintenance and ensure we always have the latest bug fixes and improvements, would it be possible to add math_verify as a direct project dependency instead of maintaining a local copy?

[hynky1999]

Hi, to give a bit of background, the math-verify started as a lighteval PR to improve the handling of math evaluations in lighteval, but as a time went we decided to out-source it to separate package as it can be used not just for evals but for verification as well.

There are small nuances between the two version -> The lighteval version hasn't been updated for a while, while the math-verify still lacks the "multilingual" support. Thus in order to be full dependency we would have to resolve the discrepancies. I do plan to do it but haven't found time for it yet, but it would be ideal to have it just pure dependency as it's painful to keep the versions in line

[jiangwangyi]

Thanks for the detailed background, that clarifies things perfectly.