Skip to content

tuplejump/continuum

Repository files navigation

Continuum Build Status

Description and documentation coming. The project is built on Akka, leverages Eventuate for the core artifact, and Apache Kafka v0.9.0.x in the cluster artifact.

This project is separated into a few modules you can chose from:

continuum-kafka

A Kafka Akka Extension - abstracts Kafka publisher and consumer APIs. Supports cluster data distribution and decoupling in the steam For more information and examples see continuum-kafka/README.md.

Getting Started

object NodeA extends App { 
  val system: ActorSystem = ...//manage lifecycle..  
}  

Use anywhere in your Akka app:

val kafka = Kafka(system) 

Basic source usages

kafka log data  

or

kafka.source ! SourceEvent()

Basic sink (consumers)

import com.tuplejump.continuum.ClusterProtocol.SinkEvent
    
class SimpleSubscriberA extends Actor { 
  def receive: Actor.Receive = { 
    case SinkEvent(_, data, _, topic,_) => process(data)
  } 
       
  def process(data: Array[Byte]): Unit = { ... } 
}

Start consuming data:

val receivers = List(subscriberA, subscriberB)
Kafka(system).sink(topics, receivers)

See continuum-kafka/README.md

continuum-common

Simple CQRS pattern support. Work in progress.

continuum-core

Leveraging Eventuate for CRDT support and in-memory use cases in distributed systems. Work in progress.

Build and Run

git clone [email protected]:tuplejump/continuum.git
cd continuum

Continuum requires Scala 2.11.x and JDK 1.8. Updating soon to support JDK 1.7.

continuum-examples

See continuum-examples/README.md for information on running the examples.

Running Tests

This is a WIP, very few tests are pushed yet but the standard is:

sbt test

Running IT (Integration) Tests

You can run all IT tests with

sbt it:test

To run modules explicitly:

sbt core/it:test
sbt kafka/it:test

Kafka IT tests use embedded-kafka. If you are running Zookeeper and/or Kafka locally, unless they are on different ports you will need to stop them first. This lets you only run those:

sbt kafka/it:test

Artifacts

This is a new project and not yet published to an artifact repo. Until then you do have to build and publish the artifacts you want. For example:

sbt kafka/publish-local

Roadmap

  • Optionally Implicit Serialization
  • Configurable serialization providers
  • Simplification of the Framework APIs
  • Tests!
  • Better types
  • More config options
  • Security
  • Much more integration with Eventuate
  • More features for Kafka
  • General cleanup - this is a new project

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages