Support for Python scripting action in hop workflow

[ossDataEngineer]

Hello Apache Hop Team,

Context:
Currently Hop Workflow supports addition of scripting actions like SQL, Javascript, etc.
Currently Hop Pipeline supports addition of scripting transforms with ability to choose engines like ECMAScript, Python, Groovy, etc.

New Idea:

1. Can we add support for Python scripting action so that it becomes convenient to write custom logic in Hop Workflow?
2. Can we standardize the scripting action like scripting transform with ability to configure engines depending on type of scripting language?

Thanks,
Apache Hop Newbie

[hansva]

It should be possible to include these scripting languages in a workflow too, that being said. I always feel that scripts should be some form of last resort. The scripting actions and transforms are also considered a security risk in many locations and thus removed.

So my question would be, what conditionals are we missing in workflows that makes you grab to a script?

Our main goal should be to create data pipelines without having to write code.

[ossDataEngineer]

Hello @hansva ,

Thanks for your response and tips regarding minimizing the use of scripting. Will keep that in mind.

I have a usecase where I need to

1. Reference the environment variables in workflow
2. Use those variables, perform some business logic to compute new variables (I wish to write this logic using Python)
3. Send these newly computed variables to child pipelines