Skip to content

Releases: apache/iceberg

Apache Iceberg 1.7.1

06 Dec 20:01
Compare
Choose a tag to compare

What's Changed

  • Kafka Connect: fix Hadoop dependency exclusion (#11516)
  • Azure: Fix ADLSLocation file parsing (#11395)
  • Azure: Support WASB scheme in ADLSFileIO (#11504)
  • Revert "Core: Use encoding/decoding methods for namespaces and deprecate Splitter/Joiner" (#11574)
  • Spark 3.5: Fix NotSerializableException when migrating Spark tables (#11157)
  • Spark: Fix changelog table bug for start time older than current snapshot (#11564)
  • Revert "Core: Update TableMetadataParser to ensure all streams closed" (#11621)

Full Changelog: apache-iceberg-1.7.0...apache-iceberg-1.7.1

Apache Iceberg 1.7.0

08 Nov 15:12
Compare
Choose a tag to compare

What's Changed

Read more

Apache Iceberg 1.6.1

27 Aug 17:47
8e9d59d
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: apache-iceberg-1.6.0...apache-iceberg-1.6.1

Apache Iceberg 1.6.0

23 Jul 12:06
229d8f6
Compare
Choose a tag to compare

What's Changed

Read more

Apache Iceberg 1.5.2

16 May 07:50
cbb8530
Compare
Choose a tag to compare

The 1.5.2 release has the same changes that the 1.5.1 release has. The 1.5.1 release had issues with the spark runtime artifacts; specifically certain artifacts were built with the wrong Scala version. It is strongly recommended to upgrade to 1.5.2 for any systems that are using 1.5.1.

Apache Iceberg 1.5.1

30 Apr 12:43
cbb8530
Compare
Choose a tag to compare

What's Changed

  • [1.5.x] API: Fix default FileIO#newInputFile ManifestFile, DataFile and DeleteFile implementations by @amogh-jahagirdar in #10114
  • [1.5.x] Core: Mark 502 and 504 failures as retryable to the exponential retry strategy by @amogh-jahagirdar in #10113
  • Core: Fix JDBC Catalog table commit when migrating from schema V0 to V1 (#101111) by @jbonofre in #10152
  • Core: Fix namespace SQL statement using ESCAPE character that works with MySQL/PostgreSQL (#10167) by @jbonofre in #10169
  • (1.5.x cherry-pick) Spark 3.5: Fix system function pushdown in CoW row-level commands by @amogh-jahagirdar in #10170
  • (1.5.x Cherry-pick) Spark 3.4: Fix system function pushdown in CoW row-level commands (#10119) by @amogh-jahagirdar in #10171

Full Changelog: apache-iceberg-1.5.0...apache-iceberg-1.5.1

Apache Iceberg 1.5.0

11 Mar 11:00
2519ab4
Compare
Choose a tag to compare

Apache Iceberg 1.5.0 was released on March 11, 2024.
The 1.5.0 release adds a variety of new features and bug fixes.

  • API
    • Extend FileIO and add EncryptingFileIO. (#9592)
    • Track partition statistics in TableMetadata (#8502)
    • Add sqlFor API to views to handle resolving a representation for a dialect(#9247)
  • Core
    • Add view support for REST catalog (#7913)
    • Add view support for JDBC catalog (#9487)
    • Add catalog type for glue,jdbc,nessie (#9647)
    • Support Avro file encryption with AES GCM streams (#9436)
    • Add ApplyNameMapping for Avro (#9347)
    • Add StandardEncryptionManager (#9277)
    • Add REST catalog table session cache (#8920)
    • Support view metadata compression (#8552)
    • Track partition statistics in TableMetadata (#8502)
    • Enable column statistics filtering after planning (#8803)
  • Spark
    • Remove support for Spark 3.2 (#9295)
    • Support views via SQL for Spark 3.4 and 3.5 (#9423, #9421, #9343, #9513, #9582)
    • Support executor cache locality (#9563)
    • Added support for delete manifest rewrites (#9020)
    • Support encrypted output files (#9435)
    • Add Spark UI metrics from Iceberg scan metrics (#8717)
    • Parallelize reading files in add_files procedure (#9274)
    • Support file and partition delete granularity (#9384)
  • Flink
    • Remove Flink 1.15
    • Adds support for 1.18 version #9211
    • Emit watermarks from the IcebergSource (#8553)
    • Watermark read options (#9346)
  • Parquet
    • Support reading INT96 column in row group filter (#8988)
    • Add system config for unsafe Parquet ID fallback. (#9324)
  • Kafka-Connect
    • Initial project setup and event data structures (#8701)
    • Sink connector with data writers and converters (#9466)
  • Spec
    • Add partition stats spec (#7105)
    • add nanosecond timestamp types (#8683)
    • Add multi-arg transform (#8579)
  • Vendor Integrations
    • AWS: Support setting description for Glue table (#9530)
    • AWS: Update S3FileIO test to run when CLIENT_FACTORY is not set (#9541)
    • AWS: Add S3 Access Grants Integration (#9385)
    • AWS: Glue catalog strip trailing slash on DB URI (#8870)
    • Azure: Add FileIO that supports ADLSv2 storage (#8303)
    • Azure: Make ADLSFileIO implement DelegateFileIO (#8563)
    • Nessie: Support views for NessieCatalog (#8909)
    • Nessie: Strip trailing slash for warehouse location (#9415)
    • Nessie: Infer default API version from URI (#9459)
  • Dependencies
    • Bump Nessie to 0.77.1
    • Bump ORC to 1.9.2
    • Bump Arrow to 15.0.0
    • Bump AWS Java SDK to 2.24.5
    • Bump Azure Java SDK to 1.2.20
    • Bump Google cloud libraries to 26.28.0

Note:

  1. To enable view support for JDBC catalog, configure jdbc.schema-version to V1 in catalog properties.

New Contributors

Read more

Apache Iceberg 1.4.3

27 Dec 17:15
9a5d24f
Compare
Choose a tag to compare

What's Changed

  • Core: Scan only live entries in partitions table (#8969) by @Fokko in #9197
  • [1.4.x] Core: Fix missing files from transaction retries with conflicting manifest merges (#9230) by @nastra in #9337
  • [1.4.x] JDBC Catalog: Fix namespaceExists check with special characters (#8340) by @ismailsimsek in #9291
  • [1.4.x] Core: Expired Snapshot files in a transaction should be deleted by @bartash in #9223
  • [1.4.x] Core: Fix missing delete files from transaction (#9354) by @nastra in #9356

Full Changelog: apache-iceberg-1.4.2...apache-iceberg-1.4.3

Apache Iceberg 1.4.2

07 Nov 16:44
f6bb917
Compare
Choose a tag to compare

What's Changed

Full Changelog: apache-iceberg-1.4.1...apache-iceberg-1.4.2

Apache Iceberg 1.4.1

23 Oct 11:03
445664f
Compare
Choose a tag to compare

What's Changed

  • Core: Do not use a lazy split offset list in manifests (#8834) by @nastra in #8845
  • Core: Ignore split offsets when the last split offset is past the file length by @amogh-jahagirdar in #8861
  • AWS: avoid static global credentials provider which doesn't play well with lifecycle management (#8677) by @nastra in #8843
  • Flink: Reverting the default custom partitioner for bucket column (#8848) by @nastra in #8858

Full Changelog: apache-iceberg-1.4.0...apache-iceberg-1.4.1