Integrate checksum support and add a configuration option for the number of prefixes.

What's Changed

• Create an NFS example. by @pspoerri in #34
• Integrate support for checksums. by @pspoerri in #35
• S3ShuffleManager: Only try to clean up shuffle files if there are no registered shuffle ids. by @pspoerri in #38
• Implement folder prefixes, sort configuration variables and improve README. by @pspoerri in #41

Full Changelog: v0.7.2...v0.8

Checksum and prefix support

What's Changed

• Spark 3.1: Add support for checksums. by @pspoerri in #37
• Spark 3.1: Improve documentation by @pspoerri in #39
• Spark 3.1: Configure the number of prefixes. by @pspoerri in #40

Full Changelog: v0.7.2-spark3.1...v0.8-spark3.1

Spark3.1: Fix timeouts issues with Hadoop-AWS.

What's Changed

• Spark 3.1: Fix TeraSort + TPC-DS Query examples. by @pspoerri in #32

Full Changelog: v0.7.1-spark3.1...v0.7.2-spark3.1

Make examples more consistent.

What's Changed

• Cleanup examples. by @pspoerri in #33

Full Changelog: v0.7.1...v0.7.2

Configuration option for prefetchBatchSize and prefetchThreadPool…

What's Changed

• Cleanup Spark 3.1 by @pspoerri in #28

Full Changelog: v0.7...v0.7.1-spark3.1

Enable configuration option for prefetchBatchSize and prefetchThreadPool…

What's Changed

• Build releases for Spark 3.4.0 and 3.2.4 with Github CI. by @pspoerri in #26
• Add examples on how to use S3 shuffle. by @pspoerri in #27
• Cleanup Spark 3.2-3.3 branch by @pspoerri in #29

Full Changelog: v0.7...v0.7.1

Performance improvements

What's Changed

• Prefetch shuffle blocks using Futures. by @pspoerri in #19
• Improve performance by placing Shuffle Blocks in different subfolders. by @pspoerri in #24
• Improve Github CI integration by @pspoerri in #23
• Re-Enable Github Actions. by @pspoerri in #22

Full Changelog: v0.6.4...v0.7

v0.7-spark3.1

S3: List/Delete using futures.

Signed-off-by: Pascal Spörri <[email protected]>

Integrate with Github CI.

What's Changed

• Improve Github CI integration by @pspoerri in #23
• Re-Enable Github Actions. by @pspoerri in #22

Full Changelog: v0.6.3...v0.6.4.1

Test Maven Packages + Build with github

What's Changed

• Re-Enable Github Actions. by @pspoerri in #22

Full Changelog: v0.6.3...v0.6.4