Skip to content

v0.4.0
Compare
Choose a tag to compare
@Meghajit Meghajit released this 22 Jul 10:34
· 21 commits to main since this release
v0.4.0
997191c
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

What's Changed

This release includes support for configuring Parquet Files as a data source.

  • feat: Add support for ParquetSource in Dagger capable of parsing primitive data types by @Meghajit in #121
  • refactor: rename packages and files in dagger-common serde by @Meghajit in #138
  • feat: Add ability to read and process complex/nested data types from a parquet file in Parquet Data Source: enums, repeated enums, message, repeated message, repeated primitives by @Meghajit in #140
  • feat: Handle complex/nested data types from a parquet file in Parquet Data Source: Struct, Repeated Struct, Maps and Timestamp of type SimpleGroup by @Meghajit in #148
  • feat: add time range filter for dagger parquet source by @prakharmathur82 in #147
  • feat: handle invalid parquet data source configs by @Meghajit in #152
  • Add exception handling for empty SOURCE_DETAILS config by @Meghajit in #162
  • Feat: ability to read from GCS buckets by @MayurGubrele in #156
  • doc: Add documentation+FAQs for Parquet DataSource by @Meghajit in #153
  • feat: implement state persistence in parquet source by @Meghajit in #163
  • feat: add parquet source metrics by @Meghajit in #174
  • feat: exclude dependencies from depot in minimalJar by @Meghajit in #180
  • chore: version bump to 0.4.0 by @Meghajit in #181

Full Changelog: v0.3.0...v0.4.0

Contributors

Meghajit, prakharmathur82, and MayurGubrele
Assets 3
Loading