Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Task Installing Remote Plugins is using confluent-hub in community version #1417

Open
rathberm opened this issue Jun 7, 2023 · 1 comment

Comments

@rathberm
Copy link

rathberm commented Jun 7, 2023

Describe the issue
Up until cp-ansible version 7.3.0, the tasks Installing Remote Plugins and Installing Local Plugins were using the ansible module unarchive to copy and extract Connect Plugins. Since Version 7.4.0 confluent-hub at {{ binary_base_path }}/bin/confluent-hub is used to install the plugins. The confluent-hub binary is not included in the community version of the confluent platform, which leads to the task failing and the plugins are not installed/copied.

We were able to work around this issue by using kafka_connect_copy_files to copy the plugins to the hosts but this does not offer the same functionality and ease of use, since it does not unpack the plugin archives and they have to be locally available on the ansible controller, since remote_src is not set.

For me it looks like that the new 7.4.0 version simply does not work with the community variant of the Confluent distribution.

Maybe it's possible to differentiate between the community and EE versions and skip the confluent-hub tasks accordingly.

To Reproduce
Steps to reproduce the behaviour:
Install a cluster using the community version of the confluent platform archive and set kafka_connect_plugins_remote or kafka_connect_plugins_local

Expected behaviour
I expected the plugins to be copied to the connect hosts and unarchived like in the previous versions.

Environment (please complete the following information):

  • OS: SUSE Linux Enterprise Server 12 SP5
  • CP-Ansible Branch: 7.4.0-post
  • Ansible Version: 2.13.5
@OneCricketeer
Copy link
Contributor

A pre-task could be added to install the confluent hub CLI, which will still work with community edition (it also works without Confluent Platform at all)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants