Intense CPU / Memory Usage with v1.66.1 Testnet

[sokiaobag]

After upgrading the testnet to v1.66.1, memory consumption has increased sharply. This appears to be causing frequent OOMKilled events. Is this expected behavior? We have not experienced this issue before.

If there are any tuning options or configuration adjustments that could help improve this, we would appreciate your advice.

We are using the following machine specifications:

CPU: AMD EPYC 4344P - 8c/16t - 3.8 GHz / 5.3 GHz
RAM: 64 GB 5200 MHz
Data disks: 4 × 960 GB SSD NVMe

Below is the current resource utilization of the Sui container:

CONTAINER ID   NAME                 CPU %     MEM USAGE / LIMIT   MEM %     NET I/O           BLOCK I/O        PIDS
1093f2093458   sui                  83.97%    53.97GiB / 54GiB    99.95%    4.29MB / 6.42MB   100GB / 3.78GB   153

Thanks.

[github-actions]

Thank you for opening this issue, a team member will review it shortly. Until then, please do not interact with any users that claim to be from Sui support and do not click on any links!

[stefan-mysten]

Thanks @sokiaobag for flagging this. May I ask if you're a validator or a fullnode operator?

[sokiaobag]

We operate a fullnode @stefan-mysten

[stefan-mysten]

I passed this internally, will get back to you asap!

[stefan-mysten]

A new release will go out soon that should fix this @sokiaobag!

[sokiaobag]

@stefan-mysten Sorry for the late confirmation, and thanks for handling this!