Ignore partition fields that are dropped from the current-schema #11868
+84
−20
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
A second attempt to fix this (the first attempt in #11604 but that one was not safe).
When a field that's dropped that still part of an older partition spec, we currently get an error. See #11842
This will replace it with the
UnknownType
which will be read as a null. This will work fine, since when the evaluator encounters anull
, it will assume that there is no value:iceberg/api/src/main/java/org/apache/iceberg/expressions/Projections.java
Lines 204 to 207 in dbd7d1c
I misused the
UnknownType
here, but I think it is better than returning an arbitrary type, like we do in theUnknownTransform
:iceberg/api/src/main/java/org/apache/iceberg/transforms/UnknownTransform.java
Lines 63 to 67 in dbd7d1c
Fixes #4563