Skip to content

Releases: dfdx/Spark.jl

v0.6.1

25 Jul 19:28
6f226df
Compare
Choose a tag to compare

Spark v0.6.1

Diff since v0.5.2

Closed issues:

  • Does Spark.jl support writing data to HDFS? (#98)
  • Class Not Found org/apache/spark/SparkConf when initialising sparkcontext (#102)
  • StackOverflowError thrown from the UncaughtExceptionHandler in thread "process reaper" (#105)
  • Nothing works (#106)

Merged pull requests:

  • RFC: PySpark-like, DataFrame-only API (#104) (@dfdx)
  • Fix Base.read() in initialization that has been overwritten by Spark.read() (#107) (@dfdx)
  • Update Project.toml (#110) (@dfdx)

v0.5.2

27 Sep 23:48
5bc6289
Compare
Choose a tag to compare

Spark v0.5.2

Diff since v0.5.1

Closed issues:

  • sparkjl jar not found (#97)

Merged pull requests:

v0.5.1

18 Jul 23:48
Compare
Choose a tag to compare

Spark v0.5.1

Diff since v0.5.0

Closed issues:

  • Serialization error (#78)
  • segfault in MacOS (#89)

Merged pull requests:

  • Add version badge, and fix pkgeval badge (#84) (@aviks)
  • Sql improvements (#88) (@anhi)
  • Check that Java is of version 1.8 (#90) (@exyi)
  • Fix dependencies when Spark 3 is used (#91) (@exyi)
  • Migrate from Travis to GitHub Actions (#92) (@dfdx)

v0.5.0

05 Jul 23:48
34de9af
Compare
Choose a tag to compare

Spark v0.5.0

Diff since v0.4.0

Closed issues:

  • Roadmap (#1)
  • Issue with cache (#33)
  • Comparing Spark.jl with other solutions (#53)
  • Julia 1.0 support (#60)
  • Order of method arguments different from Base (#66)
  • Spark.jl for Julia 1.1.0 (#70)
  • Julia-0.7 Windows gives Java error for pre-compiling (#71)
  • Is the project still active? (#72)
  • Error in InstallJuliaHDI.sh script (#76)

Merged pull requests:

  • Fixed security vulnerability in Spark (#64) (@dfdx)
  • Update Azure install script for 1.0 (#65) (@aviks)
  • Julian versions of RDD methods (#67) (@dfdx)
  • fix some issues in sql.jl (#68) (@clouds56)
  • example scala code to run julia with spark-submit (#73) (@tanmaykm)
  • Install TagBot as a GitHub Action (#74) (@JuliaTagBot)
  • Run tagbot once a day (#75) (@aviks)
  • add project.toml (#77) (@aviks)
  • Run tests on jdk8 and jdk11 separately (#79) (@aviks)
  • Use Base.invokelatest to update world age, also make a generator version (#81) (@mkitti)
  • Change just spark and scala versions for JDK 11 compatibility (#82) (@mkitti)
  • Bump version (#83) (@aviks)

Julia 0.7/1.0 support

09 Nov 21:31
9b19995
Compare
Choose a tag to compare
Merge pull request #64 from dfdx/fix-security-vulnerability

Fixed security vulnerability in Spark

Spark.jl v0.3.0

06 Mar 21:57
939ecb7
Compare
Choose a tag to compare

More functions, configurable Spark version, dropped support for Julia 0.5.

Spark.jl v0.2.0

28 Sep 19:55
Compare
Choose a tag to compare
Merge pull request #47 from dfdx/fix/build-on-travis

[WIP] Fix tests on Travis