Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adds section to describe intended usage of pipeline.buffer.type #16083

Conversation

andsel
Copy link
Contributor

@andsel andsel commented Apr 16, 2024

Release notes

[rn:skip]

PREVIEW: https://logstash_bk_16083.docs-preview.app.elstc.co/guide/en/logstash/master/jvm-settings.html

What does this PR do?

Adds section to describe the intended usage of and impact on memory sizing.

Why is it important/What is the impact to the user?

Give better insights when to use the pipeline.buffer.type and which is the expected impact on performance and memory consumption.

Checklist

  • My code follows the style guidelines of this project
  • [ ] I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • [ ] I have made corresponding change to the default configuration files (and/or docker env variables)
  • [ ] I have added tests that prove my fix is effective or that my feature works

Author's Checklist

  • [ ]

How to test this PR locally

Related issues

@andsel andsel self-assigned this Apr 16, 2024
@andsel andsel changed the title [Doc] Adds section to describe the intended usage of and impact on m… Adds section to describe intended usage of pipeline.buffer.type Apr 16, 2024
@andsel andsel marked this pull request as ready for review April 16, 2024 10:42
@andsel andsel requested review from karenzone and jsvd April 17, 2024 06:33
Copy link
Contributor

@roaksoax roaksoax left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@@ -118,6 +118,29 @@ To summarize, we have 3 categories of memory usage, where 2 can be limited by th

Keep these memory requirements in mind as you calculate your ideal memory allocation.

[[reducing-off-heap-usage]]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder if we should better highlight this somehow. The use of this setting completely changes the way Logstash works. Also, it would give us the ability to better understand Logstash when troubleshooting.

However, the direct result of this is that will completely impact/affect JVM Heap sizing. So I propose we:

  1. Bring some more visibility into this setting, maybe say this will be the default in future versions of Logstash.
  2. Tell users that this is a recommended setting to be set?
  3. And, in the memory size/performance tuning sections to have references to this setting being turned on??

Any thoughts?

@jsvd @flexitrev

Copy link
Contributor

@karenzone karenzone left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This feels like troubleshooting information more than guidance on Reducing off-heap usage. I reworked the text a bit to emphasize the troubleshooting angle. I'm wondering if this should move to the troubleshooting section rather than the best practice section.

I know that we have a JVM settings section in Best Practices, but restructuring content could make this work.

docs/static/settings-file.asciidoc Outdated Show resolved Hide resolved
docs/static/config-details.asciidoc Outdated Show resolved Hide resolved
@andsel andsel requested a review from karenzone April 23, 2024 08:52
@karenzone
Copy link
Contributor

@andsel, I left two suggestions inline. If you apply them both, that should clear the docs-ci issues. :-)

@@ -118,6 +118,29 @@ To summarize, we have 3 categories of memory usage, where 2 can be limited by th

Keep these memory requirements in mind as you calculate your ideal memory allocation.

[[reducing-off-heap-usage]]
===== Reducing off-heap usage
Some plugins like Elastic Agent, Beats, TCP and HTTP take advantage of direct memory to get
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Some plugins like Elastic Agent, Beats, TCP and HTTP take advantage of direct memory to get
Plugins like Elastic Agent, Beats, TCP, and HTTP take advantage of direct memory to achieve

docs/static/config-details.asciidoc Outdated Show resolved Hide resolved
docs/static/config-details.asciidoc Outdated Show resolved Hide resolved
@andsel andsel requested a review from jsvd May 2, 2024 08:17
docs/static/config-details.asciidoc Outdated Show resolved Hide resolved
docs/static/config-details.asciidoc Outdated Show resolved Hide resolved
docs/static/config-details.asciidoc Outdated Show resolved Hide resolved
docs/static/config-details.asciidoc Outdated Show resolved Hide resolved
docs/static/config-details.asciidoc Outdated Show resolved Hide resolved
docs/static/config-details.asciidoc Outdated Show resolved Hide resolved
@andsel andsel requested a review from jsvd May 13, 2024 08:43
Copy link
Member

@jsvd jsvd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@andsel andsel merged commit 2eebfd8 into elastic:main May 13, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants