Skip to content

Learn how to publish and subscribe to streams of event data moving through Apache Kafka

License

Notifications You must be signed in to change notification settings

mulesoft-developers/getting-started-apache-kafka-connector

Repository files navigation


Getting Started with the Apache Kafka Connector

Learn how to produce and consume events from an Apache Kafka cluster.

Tutorial and Video

For a step by step tutorial navigate to the MuleSoft developer website here

For a video of the tutorial go here.

Overview

In this tutorial, we’ll walk you through how to publish and subscribe to streams of event data moving through an Apache Kafka cluster. You’ll learn how to:

  • Setup a managed Apache Kafka cluster on Heroku
  • Setup the Apache Kafka Connector configuration
  • Subscribe to events on a Kafka topics using the Message Listener operation
  • Use the Publish operation to send messages to Kafka topics

Use the Apache Kafka Connector to participate in event driven architectures. De-couple your applications by publishing and subscribing to streams of data moving through distributed event stores like Apache Kafka.

This sample application is designed to run on MuleSoft's Anypoint Platform.

Installation Instructions

Install instructions

  1. Set up your environment.

  1. Clone this repository.

  2. In Anypoint Studio, select File > Import > Anypoint Studio > Anypoint Studio project from File System and click Next.

  3. Select the cloned repository in the Project Root and make sure to uncheck the Copy project into workspace option.

  4. Click on Finish.

  5. Create your keystore and truststore files and copy into src/main/resources

  6. Update your Apache Kafka credentials in the local.secure.yaml file. In Anypoint Studio's package explorer open src/main/resources open local.secure.yaml and update the keystore and truststore passwords. Note that password and token should be encrypted (see video and tutorial above for details).

  7. Add Runtime Configurations for env and secret.key variables. Set env to local and set encryption.key to be the value used to encrypt your secure property parameters.

Contributing

Contributions are what make the MuleSoft community such an amazing place. Any contributions you make are greatly appreciated.

See contributing.md for the MuleSoft Developer principles.

About

Learn how to publish and subscribe to streams of event data moving through Apache Kafka

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published