ParquetSharp 21.0.0

What's Changed

• Add sorting columns by @iksarfo in #536
• Upgrade C++ Arrow to 21.0.0 by @adamreeve in #548
• Allow specifying the native allocator in code by @adamreeve in #557

New Contributors

• @iksarfo made their first contribution in #536

Full Changelog: 20.0.0...21.0.0

ParquetSharp 21.0.0-beta1

What's Changed

• Add sorting columns by @iksarfo in #536
• Upgrade C++ Arrow to 21.0.0 by @adamreeve in #548
• Allow specifying the native allocator in code by @adamreeve in #557

New Contributors

• @iksarfo made their first contribution in #536

Full Changelog: 20.0.0...21.0.0-beta1

ParquetSharp 20.0.0

This version of ParquetSharp upgrades the underlying Arrow C++ Parquet library to version 20.0.0. ParquetSharp also now builds Arrow with support for the mimalloc and jemalloc native memory allocators, and will use mimalloc by default. You can switch back to the old system allocator by setting the ARROW_DEFAULT_MEMORY_POOL environment variable to system.

Note that if writing large Parquet files that use array typed columns, there is a known bug that can cause page sizes to grow large. This can be worked around by disabling page index writing.

What's Changed

• Support writing custom types that can represent nulls by @adamreeve in #526
• Support writing required byte arrays by @adamreeve in #531
• Upgrade Arrow C++ to 20.0.0 by @adamreeve in #528
• Don't require passing a logical type override for Guid typed columns by @adamreeve in #535
• Use ArrayPool for Reader and Writer Buffers by @johnthcall in #537
• Build Arrow with support for mimalloc and jemalloc by @adamreeve in #540

Full Changelog: 19.0.1...20.0.0

ParquetSharp 20.0.0-beta2

What's Changed

• Use ArrayPool for Reader and Writer Buffers by @johnthcall in #537
• Build Arrow with support for mimalloc and jemalloc by @adamreeve in #540

Full Changelog: 20.0.0-beta1...20.0.0-beta2

ParquetSharp 20.0.0-beta1

This version of ParquetSharp upgrades the underlying Arrow C++ Parquet library to version 20.0.0.

What's Changed

• Support writing custom types that can represent nulls by @adamreeve in #526
• Support writing required byte arrays by @adamreeve in #531
• Upgrade Arrow C++ to 20.0.0 by @adamreeve in #528
• Don't require passing a logical type override for Guid typed columns by @adamreeve in #535

Full Changelog: 19.0.1...20.0.0-beta1

ParquetSharp 19.0.1

This version of ParquetSharp upgrades the underlying Arrow C++ Parquet library to version 19.0.1.

What's Changed

• Add support for setting field_id on nodes by @CurtHagenlocher in #509
• Enable Control Flow Guard for windows builds by @johnthcall in #516
• Upgrade C++ Arrow to 19.0.1 by @marcin-krystianc in #520

New Contributors

• @CurtHagenlocher made their first contribution in #509
• @johnthcall made their first contribution in #516

Full Changelog: 18.1.0...19.0.1

ParquetSharp 19.0.1-beta1

What's Changed

• Add support for setting field_id on nodes by @CurtHagenlocher in #509
• Link to new documentation website from the README by @adamreeve in #511
• Bump actions/create-github-app-token from 1 to 2 by @dependabot in #514
• Enable Control Flow Guard for windows builds by @johnthcall in #516
• Bump version of Ubuntu used in GitHub actions by @adamreeve in #518
• Upgrade C++ Arrow to 19.0.1 by @marcin-krystianc in #520

New Contributors

• @CurtHagenlocher made their first contribution in #509
• @johnthcall made their first contribution in #516

Full Changelog: 18.1.0...19.0.1-beta1

ParquetSharp 18.1.0

This version of ParquetSharp upgrades the underlying Arrow C++ Parquet library to version 18.1.0.

What's Changed

• Add comparison operators and FromDotnetTicks to DateTimeNanos by @Brandon4BZ in #478
• Fix reading required string values inside an optional group by @adamreeve in #481
• Support reading and writing decimals with arbitrary length fixed-length byte array columns and writing with int32 or int64 by @adamreeve in #482
• Bump parquet-cpp-arrow to 18.1.0 by @jescalada in #492
• Handle reading files written with a non-standard map schema by @jescalada in #499
• Documentation improvements: Encryption by @jescalada in #494
• Documentation Improvements: Arrow API by @jescalada in #501

Full Changelog: 16.1.0...18.1.0

ParquetSharp 18.1.0-beta1

This version of ParquetSharp upgrades the underlying Arrow C++ Parquet library to version 18.1.0.

What's Changed

• Add comparison operators and FromDotnetTicks to DateTimeNanos by @adamreeve in #478
• Fix reading required string values inside an optional group by @adamreeve in #481
• Support reading and writing decimals with arbitrary length fixed-length byte array columns and writing with int32 or int64 by @adamreeve in #482
• Bump parquet-cpp-arrow to 18.1.0 by @jescalada in #492
• SchemaUtils Nested Map Fix by @jescalada in #499
• Documentation improvements: Encryption by @jescalada in #494

Full Changelog: 16.1.0...18.1.0-beta1

ParquetSharp 17.0.0-beta1

This version of ParquetSharp upgrades the underlying Arrow C++ Parquet library to version 17.0.0.

What's Changed

New features

• Add comparison operators and FromDotnetTicks to DateTimeNanos by @Brandon4BZ in #478

Bug fixes

• Fix reading required string values inside an optional group by @adamreeve in #481

Miscellaneous

• Upgrade C++ Arrow to 17.0.0 by @adamreeve in #479

Full Changelog: 16.1.0...17.0.0-beta1