Move EnforceDistribution
into datafusion-physical-optimizer
crate
#14186
Labels
EnforceDistribution
into datafusion-physical-optimizer
crate
#14186
Is your feature request related to a problem or challenge?
datafusion
core crate) #13814Historically DataFusion was one (very) large crate
datafusion
, and as it grew bigger we extracted various functionality into separate crates. This leads to both faster compile times (as the crates can be compiled in parallel) as well easier to navigate code (as the crates force a cleaner dependency separation)One project we have not yet completed is to extract the physical optimizer passes out #11502
Describe the solution you'd like
Extract the
EnforceDistribution
from the datafusion core crate to the datafusion-physical-optimizer crateDescribe alternatives you've considered
Move the code
Notes that due to dependencies (e.g. on SessionContext or functions), you may have to move the tests into the core_integration tests here:
Additional context
Here are some example PRs
SanityChecker
intophysical-optimizer
crate #14083Pruning
intophysical-optimizer
crate #13485I think this is a good first issue as it is mostly mechanical, has several good examples, and does not require deep internals knowledge
The text was updated successfully, but these errors were encountered: