-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Docs: Remove data_file.distinct_counts #12183
base: main
Are you sure you want to change the base?
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @jacobmarble for raising this. This should have happened a while ago to avoid unnecessary confusion.
No worries! The Iceberg spec is not perfect, but it's one of the better ones out there, so it's a pleasure to help where we can! |
Looking at this made me realize I had a similar PR a year ago. It may have slipped through. |
@@ -587,32 +587,31 @@ The schema of a manifest file is a struct called `manifest_entry` with the follo | |||
|
|||
`data_file` is a struct with the following fields: | |||
|
|||
| v1 | v2 | v3 | Field id, name | Type | Description | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can we please make this change without updating the entire table?
According to #767
data_file.distinct_counts
was deprecated about four years ago.Furthermore:
data_file
Avro objects containing this field, and will not be fixed.This PR removes the field. If deprecation is preferred, then please see #12182.