Skip to content

An example repo to show that parallel streaming with custom receiver is not possible with Spark Streaming.

License

Notifications You must be signed in to change notification settings

muthenberg/spark-streaming-custom-parallel-streams

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

  1. Build a fat jar with ./gradlew clean build shadowJar
  2. Run the created jar file ./build/libs/spark-streaming-test-all.jar with java -jar build/libs/spark-streaming-test-all.jar
  3. Uncomment line 18 in Application.java to see the infinte loop error.

About

An example repo to show that parallel streaming with custom receiver is not possible with Spark Streaming.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages