Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable pyiceberg.table.Table.add_files ns downcasting #1572

Closed

Conversation

fusion2222
Copy link

@fusion2222 fusion2222 commented Jan 24, 2025

Based on discussion in #1045

@fusion2222
Copy link
Author

The code linter has failed. Will adjust the code accordingly.

@fusion2222 fusion2222 force-pushed the feature/add-files-ns-downcasting branch from e3cab0a to 1a82544 Compare January 26, 2025 18:08
@fusion2222
Copy link
Author

fusion2222 commented Jan 26, 2025

I am a bit stucked...

Method tbl.add_files() triggers under the hood pyiceberg.io.pyarrow._ConvertToIceberg.primitive which prints to stdout / stderr warning:

"Iceberg does not yet support 'ns' timestamp precision. Downcasting to 'us'."

The old test had assertion for this warning. However I have no idea why and code does not have sensible comment to explain this and what is the rationale behind it. Is safe to remove / modify it? Some advice from more experienced contributor would be appreciated.

@fusion2222 fusion2222 force-pushed the feature/add-files-ns-downcasting branch from c14f08f to 2e65651 Compare January 26, 2025 22:11
@fusion2222 fusion2222 closed this Jan 29, 2025
@fusion2222 fusion2222 deleted the feature/add-files-ns-downcasting branch January 29, 2025 12:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant