Skip to content

Releases: data-catering/data-caterer

0.10.10

11 Jun 12:03
Compare
Choose a tag to compare

Highlights

  • Start-up Spark straight away when using UI, helps speed up first plan

Full Changelog: 0.10.9...0.10.10

0.10.9

11 Jun 06:35
Compare
Choose a tag to compare

Highlights

  • Add in delta support for Java PlanRun
  • More documentation for PlanRun methods

Full Changelog: 0.10.8...0.10.9

0.10.8

10 Jun 06:27
Compare
Choose a tag to compare

Highlights

  • Fix UI bug where relationship connection configuration would not sync with base connection configuration
  • Fix UI bug to filter out empty relationships from being persisted

Full Changelog: 0.10.7...0.10.8

0.10.7

05 Jun 06:57
Compare
Choose a tag to compare

Highlights

  • Support for Delta Lake as a data source for data generation and validation

What's Changed

  • Update datastax/dse-server Docker tag to v6.8.48 by @renovate in #30
  • Update dependency com.dimafeng:testcontainers-scala_2.12 to v0.41.3 - autoclosed by @renovate in #31
  • Update dependency com.github.pureconfig:pureconfig_2.12 to v0.17.6 by @renovate in #33
  • Update dependency com.softwaremill.quicklens:quicklens_2.12 to v1.9.7 by @renovate in #34
  • Update dependency joda-time:joda-time to v2.12.7 by @renovate in #35
  • Update dependency org.apache.commons:commons-compress to v1.26.2 by @renovate in #36
  • Update dependency org.jboss.xnio:xnio-api to v3.8.15.Final by @renovate in #37
  • Update netty monorepo to v4.1.110.Final by @renovate in #38
  • Update plugin org.jetbrains.gradle.plugin.idea-ext to v1.1.8 by @renovate in #39
  • Update dependency com.datastax.spark:spark-cassandra-connector_2.12 to v3.5.0 by @renovate in #40
  • Update dependency com.google.protobuf:protobuf-java to v3.25.3 by @renovate in #44
  • Update dependency com.nimbusds:nimbus-jose-jwt to v9.39.3 by @renovate in #45
  • Update dependency com.slack.api:slack-api-client to v1.39.3 by @renovate in #46
  • Update dependency gradle to v8.8 by @renovate in #48
  • Update dependency commons-net:commons-net to v3.11.0 - autoclosed by @renovate in #47
  • Update dependency com.fasterxml.jackson.core:jackson-databind to v2.17.1 by @renovate in #41
  • Update dependency com.fasterxml.jackson.dataformat:jackson-dataformat-yaml to v2.17.1 by @renovate in #42
  • Update dependency com.fasterxml.jackson.module:jackson-module-scala_2.12 to v2.17.1 by @renovate in #43
  • Update dependency net.minidev:json-smart to v2.5.1 by @renovate in #49
  • Update dependency org.apache.parquet:parquet-jackson to v1.14.0 by @renovate in #50
  • Update dependency org.postgresql:postgresql to v42.7.3 by @renovate in #51
  • Update dependency org.scala-lang.modules:scala-xml_2.12 to v1.3.1 by @renovate in #52
  • Update mysql Docker tag to v8.4.0 by @renovate in #56
  • Update postgres Docker tag to v14.12 - autoclosed by @renovate in #57
  • Update actions/checkout action to v4 by @renovate in #58
  • Update actions/setup-java action to v4 by @renovate in #59
  • Update dependency com.fasterxml.woodstox:woodstox-core to v6 by @renovate in #60
  • Update dependency com.google.guava:guava to v33 - autoclosed by @renovate in #61
  • Add in support for delta lake as a data source by @pflooky in #67

Full Changelog: 0.10.6...0.10.7

0.10.6

31 May 01:11
Compare
Choose a tag to compare

Highlights

  • Add in support for Iceberg data source for generation and validation
  • Fix up UI validation execution
  • Clean up validation logging
  • Clean up duplicate code for UI generation and validation
  • Update base image to allow for multi-platform images
  • Pass in Java 17 options into standalone app

What's Changed

  • Add Java 17 options to Spark JVM options, check for DEPLOY_MODE corre… by @pflooky in #23
  • Add in diagram of basic flow for Data Caterer by @pflooky in #24
  • Iceberg support by @pflooky in #29
  • Configure Renovate by @renovate in #28

New Contributors

Full Changelog: 0.10.4...0.10.6

0.10.4

24 May 01:33
aeb63bd
Compare
Choose a tag to compare

What's Changed

  • Upgrade to Spark 3.5.1, use cloudnativek8s Spark base image, resolve … by @pflooky in #20
  • Resolve vulnerabilities with kerb-admin, jetty and wildfly, update RE… by @pflooky in #21
  • Update xnio-api library by @pflooky in #22

Full Changelog: 0.10.1...0.10.4

0.10.1

15 May 02:01
02981ca
Compare
Choose a tag to compare

What's Changed

  • 3 pre condition checks before data validation by @pflooky in #15
  • Add in helper methods for Java/Scala API, ensure preFilterExpression … by @pflooky in #16
  • Update README to have clear list of data connection support, use term… by @pflooky in #17

Full Changelog: 0.9.2...0.10.1

0.9.2

24 Apr 12:38
83c3e5a
Compare
Choose a tag to compare

What's Changed

  • Add in ability to define additional connection options when creating plan by @pflooky in #11

Full Changelog: 0.9.0...0.9.2

0.9.0

09 Apr 06:22
Compare
Choose a tag to compare
  • Allow for delete relationships
    • Serves the use case of deleting generated data that is consumed and pushed to other data sources, can clean up other data source data
  • Allow users from UI to define auto schema generation via metadata sources
  • Clean up UI for data generation and validation
    • Separate cards for auto and manual generation/validation
    • Record count moved outside of manual generation
  • Move from akka to pekko
    • akka moved to a permissive business license, pekko is a fork from akka

Full Changelog: 0.8.0...0.9.0

0.8.0

05 Apr 14:45
Compare
Choose a tag to compare
  • Ability to define delete relationship fields
  • Generate different distributions when creating number of records per field(s)

Full Changelog: 0.7.0...0.8.0