Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove option for unlimited parallelism #48218

Conversation

jscheffl
Copy link
Contributor

Last moment as I was looking through the open tasks to make some cleanup before Airflow 3.0

closes: #41162
related: #41055, #41107

@jscheffl jscheffl added the airflow3.0:breaking Candidates for Airflow 3.0 that contain breaking changes label Mar 24, 2025
@boring-cyborg boring-cyborg bot added area:Executors-core LocalExecutor & SequentialExecutor area:Scheduler including HA (high availability) scheduler labels Mar 24, 2025
@jscheffl jscheffl added this to the Airflow 3.0.0 milestone Mar 24, 2025
@jscheffl jscheffl marked this pull request as ready for review March 24, 2025 22:39
@eladkal
Copy link
Contributor

eladkal commented Mar 25, 2025

Given the discussion in #41055 I think we better have mailing list discussion on this. WDYT?

@jscheffl
Copy link
Contributor Author

jscheffl commented Mar 25, 2025

Given the discussion in #41055 I think we better have mailing list discussion on this. WDYT?

I'll drop a note on devlist. --> https://lists.apache.org/thread/jlroywp6tlcrgdsx28shl1nkll8bpvbt

@jscheffl jscheffl force-pushed the feature/41162-remove-option-to-unlimited-paralellism branch from 7207319 to 06ccb3a Compare March 25, 2025 21:34
Copy link
Contributor

@o-nikolas o-nikolas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lovely! Thanks for grabbing this one @jscheffl! I've had it on a ToDo sticky note on my laptop for couple days now :)

Copy link
Member

@Lee-W Lee-W left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall looks good. one question regarding newsfragment

@jscheffl
Copy link
Contributor Author

No objections received. Merging.

@jscheffl jscheffl merged commit 9e6acf0 into apache:main Mar 27, 2025
44 checks passed
pankajkoti pushed a commit to astronomer/airflow that referenced this pull request Mar 28, 2025
* Remove option for unlimited parallelism

* Add newsfragment

* Update newsfragments/48218.significant.rst

Co-authored-by: Jed Cunningham <[email protected]>

* Fix newsfragment static check

---------

Co-authored-by: Jed Cunningham <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
airflow3.0:breaking Candidates for Airflow 3.0 that contain breaking changes area:Executors-core LocalExecutor & SequentialExecutor area:Scheduler including HA (high availability) scheduler
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Remove the ability to set parallelism to infinity in Airflow V3
8 participants