Forest v0.16.1 "(Re)Fresh(ed)Melon"

This is yet another mandatory upgrade for calibration network, containing the 2nd fix for the WatermelonFix upgrade. See this update for reference.

What's Changed

• fix: align forest-cli chain head output format with lotus chain head by @hanabi1224 in #3697
• [CI] Add 'car_db' migration checks. by @ruseinov in #3692
• fix: Make Filecoin.ChainReadObj RPC API compatible with lotus by @hanabi1224 in #3696
• test: compare Lotus compatibility for StateAccountKey, StateCirculatingSupply and StateDecodeParams by @lemmih in #3688
• fix: align forest-cli chain message output format with lotus chain getmessage by @hanabi1224 in #3701
• feat: print root CIDs in forest-tool archive info output by @hanabi1224 in #3700
• fix(api compare): test get_xx_messages API with the last 20 tipsets by @hanabi1224 in #3702
• fix: Add back chain overriding in case we did not find any config file by @elmattic in #3693
• fix(api compare): deduplicate messages in snapshot_tests by @hanabi1224 in #3703
• fix: Filecoin.ChainGetMessage server error when requesting a signed message by @hanabi1224 in #3708
• [Chore] Parallel graph streaming for GC. by @ruseinov in #3706
• fix: align forest-cli chain message output with lotus by @hanabi1224 in #3709
• Implemented Filecoin.Filecoin.StateGetRandomnessFromBeacon API by @sudo-shashank in #3704
• fix(libp2p): increase bitswap timeout by @hanabi1224 in #3713
• chore(deps): bump serde_json from 1.0.107 to 1.0.108 by @dependabot in #3711
• [Chore] Filecoin.StateMinerPower lotus compatibility. by @ruseinov in #3707
• watermelon fix 2 by @LesnyRumcajs in #3722
• fix(libp2p): reduce connection limits by @hanabi1224 in #3712
• chore: prepare release v0.16.1 by @hanabi1224 in #3723

Full Changelog: v0.16.0...v0.16.1

Forest v0.16.0 "Rottenmelon" 🪳🍉

This is a mandatory upgrade for calibration network, containing fix for the WatermelonFix upgrade. See Lotus release for reference.

What's Changed

• chore(deps): bump indexmap from 2.0.2 to 2.1.0 by @dependabot in #3677
• [Feature] Mark-and-sweep GC. by @ruseinov in #3504
• fix: properly track Kademlia metrics in Prometheus by @hanabi1224 in #3672
• fix: correct typo in RPC developer documentation by @elmattic in #3678
• Docker image: retag workflow by @LesnyRumcajs in #3679
• fix wrong log level by @LesnyRumcajs in #3680
• Fix Sync Wait to wait until forest enters follow mode by @sudo-shashank in #3660
• Revert "[Feature] Mark-and-sweep GC. (#3504)" by @LesnyRumcajs in #3682
• Fix retag workflow + add link by @LesnyRumcajs in #3681
• chore: upgrade go-libp2p and go-bitswap in go-compatibility tests by @hanabi1224 in #3684
• booleans are not booleans in GH inputs by @LesnyRumcajs in #3687
• [Feature] Mark-and-sweep GC. by @ruseinov in #3689
• fix: update bitswap to use quick-protobuf to match rust-libp2p by @hanabi1224 in #3683
• feat: implement testing of Filecoin.ChainGetBlockMessages API by @elmattic in #3675
• Fix the watermelon fix by @LesnyRumcajs in #3694
• prepare release v0.16.0 by @LesnyRumcajs in #3695

Full Changelog: v0.15.1...v0.16.0

Forest v0.15.2 "Defenestration"

This is an obligatory release to keep up with the calibration network after epoch 1070494, which should be 2023-11-07T13:00:00UTC.

Added

• #3632 Added an upgrade/fix for calibration network that will go live at epoch 1070494.

• #3674 Added a tentative mainnet Watermelon upgrade with the 12.0.0-rc.2 bundle.

What's Changed

• utils/misc: update forest ascii logo by @q9f in #3661
• Monthly update of snapshot checkpoints by @jdjaustin in #3651
• fix: libp2p discovery is not properly setup by @hanabi1224 in #3621
• chore: test high-priority RPC methods by @lemmih in #3657
• feat: Enable libp2p::autonat protocol by @hanabi1224 in #3653
• chore: disable flaky lint by @aatifsyed in #3666
• Remove the hidden cli subcommands by @elmattic in #3663
• daemon: download only bundles for the given network by @LesnyRumcajs in #3658
• feat: add filtering and early exit to api compare command by @lemmih in #3662
• release: v0.15.1 by @elmattic in #3667
• feat: implement Filecoin.ChainGetMessagesInTipset API (server side) by @hanabi1224 in #3670
• fix: align JSON schema for StateGetActor with Lotus by @lemmih in #3664
• Calibnet Watermelon fix + mainnet watermelon upgrade by @LesnyRumcajs in #3674
• prepare release v0.15.2 "Defenestration" by @LesnyRumcajs in #3676

Full Changelog: v0.15.0...v0.15.2

Forest v0.15.1

Forest v0.15.1 is a service release with support for the v0.14.1 database.

Forest v0.14.1

Our v0.14.0 release was too big, and we could not publish it. This release backports the fix #3622 so we can do it.

Forest v0.15.0 "Buttress"

This is a service release containing minor bug fixes and small usability improvements.

Forest v0.14.0 "Hakuna Matata"

Notable updates

• Added NV21 (Watermelon) support for the calibration network.
• Fixed a bug in the ForestCAR encoder that would cause corrupted archives if a hash-collision happened.

Detailed changelog

• chore: take new release of unsigned-varint by @hanabi1224 in #3475
• chore(deps): unify bytes crate version in dependency tree by @hanabi1224 in #3476
• Remove unused benchmark/metrics script files that were moved to forest-iac by @jdjaustin in #3483
• [Feature] Unordered parallel graph walk V3 by @ruseinov in #3474
• Replace generate_hash_maps method with Arbitrary implementation by @jdjaustin in #3469
• chore(deps): unify cfg-if version by upgrading raw_sync by @hanabi1224 in #3477
• chore(deps): bump docker/build-push-action from 4 to 5 by @dependabot in #3491
• chore: rename Block to CarBlock by @lemmih in #3493
• chore(deps): bump docker/setup-qemu-action from 2 to 3 by @dependabot in #3495
• fix: disable flaky migration test by @lemmih in #3494
• chore: use nonempty vector to eliminate unwraps in tipset groups by @lemmih in #3497
• feat: download snapshots from CloudFlare by @lemmih in #3492
• Add CarWriter sink by @elmattic in #3461
• chore(deps): bump mimalloc from 0.1.38 to 0.1.39 by @dependabot in #3501
• fix: Lazy<Vec> should just be &[&str] by @hanabi1224 in #3503
• chore(deps): upgrade fvm deps by @hanabi1224 in #3481
• chore: remove stream seek constraint by @lemmih in #3505
• refactor: cid_collections by @aatifsyed in #3502
• fix: truncated actor bundles #3485 by @aatifsyed in #3488
• chore: remove unused RPCState field by @lemmih in #3496
• chore: re-organize chain muxer tests by @lemmih in #3506
• docs: state diagrams for the chain muxer and tipset processor by @lemmih in #3507
• fix(ci): fix RUSTSEC-2023-0063 to unblock CI by @hanabi1224 in #3513
• Use the new CarWriter sink by @elmattic in #3487
• chore: refactor futures in the ChainMuxer and TipsetProcessor by @lemmih in #3508
• fix db migration test by @ruseinov in #3517
• chore(deps): bump tokio-util from 0.7.8 to 0.7.9 by @dependabot in #3515
• chore(deps): bump tungstenite from 0.20.0 to 0.20.1 by @dependabot in #3519
• chore(deps): upgrade non-fvm deps by @hanabi1224 in #3521
• refactor: use bigint directly rather than from the fvm by @lemmih in #3522
• fvm4 shim types by @hanabi1224 in #3520
• ci: use fuzzy as an action runner by @lemmih in #3514
• ci: send db-migration output to stdout rather than a file by @lemmih in #3528
• migration declaration as macro by @LesnyRumcajs in #3530
• [Fix] create_migrations macro. by @ruseinov in #3533
• Monthly update of snapshot checkpoints by @jdjaustin in #3535
• chore(deps): bump clap from 4.4.5 to 4.4.6 by @dependabot in #3536
• fix: return early for out-of-bounds mmap reads by @lemmih in #3448
• write bundle path to stdout by @LesnyRumcajs in #3542
• refactor: manifest by @aatifsyed in #3545
• remove banned deps lint by @LesnyRumcajs in #3544
• chore: take ownership of command arguments by @lemmih in #3539
• refactor: anyhow usage by @aatifsyed in #3546
• chore: bump rust toolchain to 1.73 by @hanabi1224 in #3553
• fix: refactor TipsetRangeSyncerFuture into idiomatic futures by @hanabi1224 in #3554
• chore(deps): bump libc from 0.2.148 to 0.2.149 by @dependabot in #3559
• chore: configure update groups for dependabot by @hanabi1224 in #3561
• chore(deps): bump memmap2 from 0.8.0 to 0.9.0 by @dependabot in #3563
• chore(deps): bump num-derive from 0.4.0 to 0.4.1 by @dependabot in #3566
• remove flaky rolling db test by @LesnyRumcajs in #3568
• fix(ci): use local FS for sccache on fuzzy by @hanabi1224 in #3564
• chore(deps): bump byteorder from 1.4.3 to 1.5.0 by @dependabot in #3569
• chore(deps): bump lru from 0.11.1 to 0.12.0 by @dependabot in #3574
• feat: custom lints by @aatifsyed in #3552
• refactor: use zerocopy for IndexHeader instead of manually slicing by @aatifsyed in #3580
• chore: trace verbose coverage report by @aatifsyed in #3582
• feat: lint TODO comments by @aatifsyed in #3560
• wibble: fix RPC parameter in ci_check script by @lemmih in #3583
• fix: don't drop colliding keys from ForestCAR by @lemmih in #3590
• NV21 Watermelon 🍉 support by @LesnyRumcajs in #3541
• Prepare release v0.14.0 "Hakuna Matata" 🐗 🦁 by @LesnyRumcajs in #3594

Full Changelog: v0.13.0...v0.14.0

Forest v0.13.0 "Holocron"

Notable Updates

• New binary: forest-tool
• Significant performance improvements when using .forest.car.zst files.
• Exporting snapshots is multi-threaded rather than single-threaded, yielding ~40% better performance.

Forest v0.12.1 "Carp++"

Notable Updates

• Reduce memory required to export a mainnet snapshot from 14GiB to 7GiB.

Forest v0.12.0 "Carp"

Notable Updates

• Support for .forest.car.zst files.
• Support for diff snapshots.

What's changed?

Breaking

• #3189: Changed the database
  organisation to use multiple columns. The database will need to be recreated.
• #3220: Removed the
  forest-cli chain validate-tipset-checkpoints and
  forest-cli chain tipset-hash commands.

Added

• #3167: Added a new option
  --validate-tipsets for forest-cli snapshot validate.
• #3166: Add
  forest-cli archive info command for inspecting archives.
• #3159: Add
  forest-cli archive export -e=X command for exporting archives.
• #3150:
  forest-cli car concat subcommand for concatenating .car files.
• #3148: add save_to_file
  option to forest-cli state fetch command.
• #3213: Add support for
  loading forest.car.zst files.
• #3284: Add --diff flag to
  archive export.
• #3292: Add net info
  subcommand to forest-cli.

Changed

• #3126: Bail on database
  lookup errors instead of silently ignoring them.
• #2999: Restored --tipset
  flag to forest-cli snapshot export to allow export at a specific tipset.
• #3283: All generated car
  files use the new forest.car.zst format.

Removed

Fixed

• #3248: Fixed Forest being
  unable to re-create its libp2p keypair from file and always changing its
  PeerId.