You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
At present the two key DataFusion interfaces for Iceberg lack statistics information, as they rely on default (i.e. missing/unknown) implementations for TableProvider::statistics and ExecutionPlan::statistics.
These can be quite important (particularly the later one) during join planning, as DataFusion uses a number of heuristics that are based on these stats when planning joins, and so they can impact performance.
The text was updated successfully, but these errors were encountered:
At present the two key DataFusion interfaces for Iceberg lack statistics information, as they rely on default (i.e. missing/unknown) implementations for
TableProvider::statistics
andExecutionPlan::statistics
.These can be quite important (particularly the later one) during join planning, as DataFusion uses a number of heuristics that are based on these stats when planning joins, and so they can impact performance.
The text was updated successfully, but these errors were encountered: