Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate max_wal_size configuration in Railway #73

Open
lightwalker-eth opened this issue Jan 24, 2025 · 3 comments
Open

Investigate max_wal_size configuration in Railway #73

lightwalker-eth opened this issue Jan 24, 2025 · 3 comments
Assignees
Labels
devops DevOps related question Further information is requested
Milestone

Comments

@lightwalker-eth
Copy link
Member

Image

Image

I noticed the above being flagged in the logs.

Additionally, note the messages about: "checkpoints are occurring too frequently (18 seconds apart)"

@lightwalker-eth lightwalker-eth added the question Further information is requested label Jan 24, 2025
@lightwalker-eth lightwalker-eth added this to the v2+ milestone Jan 24, 2025
@lightwalker-eth lightwalker-eth moved this to Backlog in ENSNode Jan 24, 2025
@lightwalker-eth lightwalker-eth added the devops DevOps related label Jan 31, 2025
@lightwalker-eth lightwalker-eth modified the milestones: v2+, v1 Jan 31, 2025
@lightwalker-eth lightwalker-eth moved this from Backlog to Todo in ENSNode Jan 31, 2025
@BanaSeba
Copy link
Collaborator

@lightwalker-eth Those are not errors, it's a regular Postgres procedure (Railway seems to not understand this as this is using LOG ?).
Time between those is not dramatic considering how much I/O stuff is going on during the indexing process. I would not suggest adjusting max_wal_size. This should not have a bigger impact on the indexing process.
I would consider this task as ready to close.

@BanaSeba BanaSeba moved this from Todo to Ready for Review in ENSNode Feb 21, 2025
@lightwalker-eth
Copy link
Member Author

@BanaSeba Thanks, appreciate your advice and understand these aren't errors, but rather interpret them as warnings of a potential optimization opportunity.

Could you please investigate what max_wal_size is actually being applied in our Railway deployment of Postgres?

@lightwalker-eth lightwalker-eth moved this from Ready for Review to Todo in ENSNode Feb 21, 2025
@BanaSeba
Copy link
Collaborator

@lightwalker-eth max_wal_size is using the default value (1GB). Referring to the official doc This parameter can only be set in the postgresql.conf file or on the server command line.

  • Tuning this will not have a meaningful impact on indexing
  • It takes bigger work to set this in Railway (probably using our predefined Docker image)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
devops DevOps related question Further information is requested
Projects
Status: Todo
Development

No branches or pull requests

3 participants