Skip to content

Commit

Permalink
Filter rows directly from pa.RecordBatch (#1621)
Browse files Browse the repository at this point in the history
This [PR](apache/arrow#39220) from Apache
Arrow was merged to allow to filter with a boolean expression directly
on `pa.RecordBatch`.

I believe pyiceberg is currently using pyarrow version 19.0.0.
Filtering from pa.RecordBatch was introduced in python in version 17.0.0

I have not run integration tests for some reason my docker setup is
messed up. I believe this test should check this change:
https://github.com/apache/iceberg-python/blob/dfbee4b0023ff8442c7d27194dc2edc66b15142d/tests/integration/test_deletes.py#L314

Closes #1050

---------

Co-authored-by: Kevin Liu <[email protected]>
Co-authored-by: Gabriel Igliozzi <[email protected]>
  • Loading branch information
3 people authored Feb 13, 2025
1 parent 38d57ea commit 6d1c30c
Show file tree
Hide file tree
Showing 3 changed files with 815 additions and 730 deletions.
Loading

0 comments on commit 6d1c30c

Please sign in to comment.