Skip to content

Commit

Permalink
RND-558 Reading from Kafka Topics (#290)
Browse files Browse the repository at this point in the history
* RND-558 Reading from Kafka Topics

Add sample code to read topics from Kafka using Kafkajs and rdkafka

* Update clients to read by batch or each message.

* Update Kafka docker compose to enable reading from typescript

* Update package-lock.json

* Update docker-compose.yml

* Update docker-compose.yml

* Update package.json

* Remove rdkafka package

* Add Kafkajs test

* Update kafkajsWorker.test.ts

Fix linting errors

* Update kafkajsWorker.test.ts

Remove console log

* Update jest.config.js

Update to ignore unit test from kafka folder.
  • Loading branch information
jleiva-gap authored Aug 23, 2023
1 parent efd2693 commit c0f0e37
Show file tree
Hide file tree
Showing 8 changed files with 2,538 additions and 2,409 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,8 @@ services:
- zookeeper
environment:
- ZOOKEEPER_CONNECT=zookeeper:2181
- KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://kafka1:9092


connect:
hostname: kafka-connect
Expand All @@ -41,7 +43,7 @@ services:
links:
- kafka
environment:
- BOOTSTRAP_SERVERS=kafka:9092
- BOOTSTRAP_SERVERS=kafka1:9092
- GROUP_ID=1
- CONFIG_STORAGE_TOPIC=debezium_config
- OFFSET_STORAGE_TOPIC=debezium_offset
Expand Down
Loading

0 comments on commit c0f0e37

Please sign in to comment.