Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: apply pruning pipeline in EXPLAIN to avoid OOM #17491

Draft
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

dqhl76
Copy link
Collaborator

@dqhl76 dqhl76 commented Feb 20, 2025

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

This PR extends support for the pruning pipeline to EXPLAIN statements when enable_prune_pipeline=1. The pruning pipeline support streaming reading block metas to prevent OOM risks for large or numerous blocks.

Tests

  • Unit Test
  • Logic Test
  • Benchmark Test
  • No Test - Explain why

Type of change

  • Bug Fix (non-breaking change which fixes an issue)
  • New Feature (non-breaking change which adds functionality)
  • Breaking Change (fix or feature that could cause existing functionality not to work as expected)
  • Documentation Update
  • Refactoring
  • Performance Improvement
  • Other (please describe):

This change is Reviewable

@github-actions github-actions bot added the pr-bugfix this PR patches a bug in codebase label Feb 20, 2025
@dqhl76 dqhl76 closed this Mar 28, 2025
@BohuTANG
Copy link
Member

@dqhl76 This was closed without explanation. Could you clarify why?

@dqhl76
Copy link
Collaborator Author

dqhl76 commented Mar 28, 2025

Misoperation, I recently want to continue pushing this PR move.

@dqhl76 dqhl76 reopened this Mar 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pr-bugfix this PR patches a bug in codebase
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants