[Feature][EMR Task] Amazon EMR task jobFlowDefineJson supports parameter passing functionality #15971
Open
3 tasks done
Comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
{{ message }}
Search before asking
Description
On the AWS platform, many customers use EMR to submit tasks like Spark. DolphinScheduler uses jobFlowDefineJson to define EMR task parameters, but currently does not support parameter passing from upstream tasks. Users hope to define parameters in Spark, such as date and time, by passing parameters.
Use case
On the AWS platform, many customers use EMR to submit tasks like Spark. DolphinScheduler uses jobFlowDefineJson to define EMR task parameters, but currently does not support parameter passing from upstream tasks. Users hope to define parameters in Spark, such as date and time, by passing parameters.
Related issues
No response
Are you willing to submit a PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: