Skip to content

[SPARK-52422][PYTHON] Update pandas to 2.3.0 #51123

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 7 commits into
base: master
Choose a base branch
from

Conversation

bjornjorgensen
Copy link
Contributor

@bjornjorgensen bjornjorgensen commented Jun 9, 2025

What changes were proposed in this pull request?

Upgrading from pandas==2.2.3 to pandas==2.3.0

Why are the changes needed?

Release Github

Release notes

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass GA

Was this patch authored or co-authored using generative AI tooling?

No.

@HyukjinKwon
Copy link
Member

LGTM if tests pass.

@bjornjorgensen bjornjorgensen changed the title [WIP] Update to Pandas 2.3.0 [WIP][SPARK-52422][PS] Update to Pandas 2.3.0 Jun 9, 2025
@zhengruifeng
Copy link
Contributor

LGTM pending CI

@zhengruifeng
Copy link
Contributor

shall we also update dev/requirements.txt?

@zhengruifeng
Copy link
Contributor

There are also some non-docker workflows, e.g. python3.11 with arm

@zhengruifeng zhengruifeng changed the title [WIP][SPARK-52422][PS] Update to Pandas 2.3.0 [WIP][SPARK-52422][PYTHON] Update to Pandas 2.3.0 Jun 9, 2025
@bjornjorgensen bjornjorgensen changed the title [WIP][SPARK-52422][PYTHON] Update to Pandas 2.3.0 [SPARK-52422][PYTHON] Update pandas to 2.3.0 Jun 9, 2025
@bjornjorgensen
Copy link
Contributor Author

There are also some non-docker workflows, e.g. python3.11 with arm

Where are they and should I also update they?

@bjornjorgensen
Copy link
Contributor Author

There might be some problems with python 3.9 and pandas version 2.3.0 pandas-dev/pandas#61590

@bjornjorgensen
Copy link
Contributor Author

shall we also update dev/requirements.txt?

Well for python 3.9 users this might be a issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants