Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

kedro-airflow: Follow the TaskFlow paradigm for DAGs? #545

Closed
ankatiyar opened this issue Feb 7, 2024 · 1 comment
Closed

kedro-airflow: Follow the TaskFlow paradigm for DAGs? #545

ankatiyar opened this issue Feb 7, 2024 · 1 comment
Labels
airflow
Milestone
Fix and improve k...

Comments

@ankatiyar
Copy link
Contributor

Description

Since 2.0, apache-airflow has introduced the TaskFlow API which is a new way of writing DAGs.
Link for more info - https://airflow.apache.org/docs/apache-airflow/stable/tutorial/taskflow.html

They still support the traditional paradigm for DAGs which is what kedro-airflow follows right now.

Possible Implementation

  • Switch entirely to the new API?
  • Let users choose which version of the DAGs they want, maybe with a CLI option?
@ankatiyar
Copy link
Contributor Author

I just saw there is an existing issue for this #25
Closing this.

@ankatiyar ankatiyar closed this as not planned Won't fix, can't repro, duplicate, stale Feb 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
airflow
Projects
None yet
Milestone
Fix and improve kedro-airflow
Development

No branches or pull requests
1 participant
@ankatiyar