Update polars requirement from <1.18.0,>=0.20.26 to >=0.20.26,<1.23.0 #1544

dependabot · 2025-02-10T08:27:20Z

Updates the requirements on polars to permit the latest version.

Release notes

Python Polars 1.22.0

🚀 Performance improvements

Reduce sharing in stringview arrays in new-streaming equijoin (#21129)

Implement native Expr.count() on new-streaming (#21126)

Speed up list operations that use amortized_iter() (#20964)

Use Cow as output for rechunk and add rechunk_mut (#21116)

Reduce arrow slice mmap overhead (#21113)

Reduce conversion cost in chunked string gather (#21112)

Enable prefiltered by default for new streaming (#21109)

Enable parquet column expressions for streaming (#21101)

Deduplicate buffers again in stringview concat kernel (#21098)

Add dedicated concatenate kernels (#21080)

Rechunk only once during join probe gather (#21072)

Micro-optimise internal DataFrame height and width checks (#21071)

Speed up from_pandas when converting frame with multi-index columns (#21063)

Change default memory prefetch to MADV_WILLNEED (#21056)

Remove cast to boolean after comparison in optimizer (#21022)

Split last rowgroup among all threads in new-streaming parquet reader (#21027)

Recombine into larger morsels in new-streaming join (#21008)

Improve list.min and list.max performance for logical types (#20972)

Ensure count query select minimal columns (#20923)

✨ Enhancements

Add projection pushdown to new streaming multiscan (#21139)

Implement join on struct dtype (#21093)

Use unique temporary directory path per user and restrict permissions (#21125)

Enable ingest of objects supporting the PyCapsule interface via from_arrow (#21128)

Enable new streaming multiscan for CSV (#21124)

Environment POLARS_MAX_CONCURRENT_SCANS in multiscan for new streaming (#21127)

Ensure AWS credential provider sources AWS_PROFILE from environment after deserialization (#21121)

Multi/Hive scans in new streaming engine (#21011)

Add linear_spaces (#20941)

IO plugins suppport lazy schema (#21079)

Add write_table() function to Unity catalog client (#21089)

Add is_object method to Polars DataType class (#21074)

Implement merge_sorted for binary (#21045)

Hold string cache in new streaming engine and fix row-encoding (#21039)

Add CredentialProviderAzure parameter to accept user-instantiated azure credential classes (#21047)

Expose unity catalog dataclasses and type aliases (#21046)

Support max/min method for Time dtype (#19815)

Implement a streaming merge sorted node (#20960)

Automatically use temporary credentials API for scanning Unity catalog tables (#21020)

Add negative slice support to new-streaming engine (#21001)

Allow for more RG skipping by rewriting expr in planner (#20828)

Rename catalog schema to namespace (#20993)

Add functionality to create and delete catalogs, tables and schemas to Unity catalog client (#20956)

Allow custom JSONEncoder for the json_normalize function, minor speedup (#20966)

Support passing aws_profile in storage_options (#20965)

... (truncated)

Commits

ff994f0 Python Polars 1.22 (#21141)
e8e0295 fix: Fix Expr.over applying scale incorrectly for Decimal types (#21140)
f1f3775 feat: Add POLARS_ALLOW_UNSECURED_TEMP_DIR environment variable (#21137)
875829b feat: Add projection pushdown to new streaming multiscan (#21139)
1aab51c feat: Implement join on struct dtype (#21093)
63cdab5 fix: Fix IO plugin predicate with failed serialization (#21136)
5121c53 fix(python): Ensure lit handles datetimes with tzinfo that represents a fix...
a442d6f fix: Fix cse panic (#21135)
1b225fc feat: Use unique temporary directory path per user and restrict permissions (...
446b270 fix: Correctly implement take_(opt_)chunked_unchecked for structs (#21134)
Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot merge will merge this PR after your CI passes on it
@dependabot squash and merge will squash and merge this PR after your CI passes on it
@dependabot cancel merge will cancel a previously requested merge and block automerging
@dependabot reopen will reopen this PR if it is closed
@dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
@dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Updates the requirements on [polars](https://github.com/pola-rs/polars) to permit the latest version. - [Release notes](https://github.com/pola-rs/polars/releases) - [Commits](pola-rs/polars@py-0.20.26...py-1.22.0) --- updated-dependencies: - dependency-name: polars dependency-type: direct:development ... Signed-off-by: dependabot[bot] <[email protected]>