Enhance streaming writes to metadata #17491
Description
Feature Description
What the feature achieves:
Streaming writes to metadata table using the same RDD chain as data table writes.
#17102
Why this feature is needed:
This will give hudi a powerful streaming semantics for collecting stats and writing to metadata table.
User Experience
How users will use this feature:
This will be more of a performance change and not really user accessible one.
- Configuration changes needed
- API changes
- Usage examples
Hudi RFC Requirements
RFC PR link: (if applicable)
Why RFC is/isn't needed:
- Does this change public interfaces/APIs? (Yes/No)
- Does this change storage format? (Yes/No)
- Justification: