Deployment Process in production in Apache Hop

[Visal-Som30]

Hello Apache Hop team,

I'm a beginner to Apache Hop. My company wants me to deploy Apache Hop on-premise in production. Can you explain me about deployment process? (e.g. standalone or cluster, hardware requirements, configuration, ...)

Thank you in advance.

[liosc]

Hi @Visal-Som30 , first of all, as you are a beginner, welcome to Hop community. Second, I would like to share with you my personal thought: as you are a beginner and your company asked to deploy Apache Hop in production, have you already thought about getting professional support from an experienced company or consultant? Just to be sure to start in the right direction. We, as a community, are here to help each other but from being a beginner to deploy in production the leap could be dangerous. Just my personal opinion.

[Visal-Som30]

Thanks for this informative answer. Anyway If I have more questions, can I ask?

[bamaer]

of course, that's what these discussions are for.

[Visal-Som30]

Hello Sir,

I want to deploy Apache Hop Server on-premises, can you recommend hardware requirement? I know that it depends on a lot of factors, but just give a common one that most Apace Hop users use.

Best regards,

[bamaer]

you're right, it does depend on a lot of factors. With the default memory allocation of 2GB, you could go as low as e.g. a 2 CPU/core machine with 8GB RAM (probably even lower), but it all depends on your use cases, the volume of data you need to process and what your (workflows and) pipelines look like. What makes sense in one use case could be nonsense in another one.

[Visal-Som30]

Sir, I have another question. If I deploy my Apache Hop, I need only one server and then I just change metadata environments, right? But If I deploy Apache Hop that can distribute execution so I need multiple servers, right?

[bamaer]

Hop Server doesn't support distributed execution. You could set up some distribution framework yourself, but for real distributed processing, you could look at the Apache Beam pipeline run configurations to run on Apache Spark or Google Dataflow. The very low machine configurations I mentioned earlier won't be enough for those clusters hosts though. It all depends on a lot of factors ;-)

[Visal-Som30]

Thank you so much for this informative answer, sir.