Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CDAP-21148] check pipeline size on change and before save / deploy #1296

Open
wants to merge 1 commit into
base: develop
Choose a base branch
from

Conversation

GnsP
Copy link
Collaborator

@GnsP GnsP commented Feb 28, 2025

Check pipeline size is less than 2MB

Description

Summary of changes

PR Type

  • Bug Fix
  • Feature
  • Build Fix
  • Testing
  • General Improvement
  • Cherry Pick

Links

Jira: CDAP-21148

Test Plan

Screenshots

The pipeline in this screenshot has a large description
image

@GnsP GnsP added the build triggers github action label Feb 28, 2025
@sidhdirenge sidhdirenge requested a review from vsethi09 February 28, 2025 10:59
@@ -1456,6 +1457,16 @@ class HydratorPlusPlusTopPanelCtrl {
}

let uploadedFile = files[0];

const MB = 1024 * 1024; // Bytes
if (files[0].size > 2 * MB) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can we make it configurable from CConf?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, we can. Would require backend changes also. We would need the value inside CDAP_CONFIG.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For now, we are going to to keep this size limit as a static value in the UI.

Copy link

@sidhdirenge sidhdirenge Mar 2, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's make it configurable from cConf if possible?
We are planning to introduce chunking soon, so UI check can become a blocker during testing

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, we can. Would require backend changes also. We would need the value inside CDAP_CONFIG.

I don't think we need the changes in backend for this.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, we do. Here is the corresponding backend PR: cdapio/cdap#15921

@GnsP GnsP changed the title check pipeline size on change and before save / deploy [CDAP-21148] check pipeline size on change and before save / deploy Feb 28, 2025
@GnsP GnsP force-pushed the add-pipeline-size-check branch from 45e6fd3 to 5b2bc33 Compare February 28, 2025 11:48
@GnsP GnsP force-pushed the add-pipeline-size-check branch from dadb725 to 5267dd1 Compare March 3, 2025 14:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build triggers github action
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants