Ensure HTTP/2 flow control to work at the stream level

[ikhoon]

Motivation:

Since InboundTrafficController operates at the TCP level, it isn't aligned with HTTP/2 flow control. As a result, a stream may receive more than its stream window size allows and interfering with other streams from receiving data.

Related: #6253

Modifications:

• Integrated InboundTrafficController with HTTP/2 Http2LocalFlowController
  • Invokes Http2LocalFlowController.consumeBytes() when steam data is consumed to send a WINDOW_UPDATE frame.
• Introduced {ServerBuilder,ClientFactoryBuilder}.http2StreamWindowUpdateRatio to customize the threshold to send WINDOW_UPDATE frames.
• Fixed client.Http2ResponseDecoder and server.Http2RequestDecoder to defer reporting the consumed data length.
  • The length is not reported via InboundTrafficController when the data is consumed in userland.

Result:

• Fixed a bug where HTTP/2 flow control did not work properly, and stream-level windowing was ignored.
• Closes Potential bug: InboundTrafficController applies back-pressure at connection level only, ignoring per-stream windows #6253

[github-actions]

🔍 Build Scan® (commit: 114f227)

Job name	Status	Build Scan®
build-ubicloud-standard-16-jdk-8	✅	https://ge.armeria.dev/s/dfxbo2ipzzbu4
build-ubicloud-standard-16-jdk-21-snapshot-blockhound	❌ (failure)	https://ge.armeria.dev/s/tw6p6vl7w6szm
build-ubicloud-standard-16-jdk-17-min-java-17-coverage	✅	https://ge.armeria.dev/s/odxp2jmyuii32
build-ubicloud-standard-16-jdk-17-min-java-11	✅	https://ge.armeria.dev/s/c2kjmoe5whkkm
build-ubicloud-standard-16-jdk-17-leak	✅	https://ge.armeria.dev/s/d5ynryxhzxloy
build-ubicloud-standard-16-jdk-11	✅	https://ge.armeria.dev/s/tpnuqt6xfbnv6
build-macos-latest-jdk-21	✅	https://ge.armeria.dev/s/lasp5u6yjr55m

[codecov]

Codecov Report

Attention: Patch coverage is 91.11111% with 8 lines in your changes missing coverage. Please review.

Project coverage is 74.57%. Comparing base (8150425) to head (114f227).
Report is 104 commits behind head on main.

Files with missing lines	Patch %	Lines
...eria/internal/common/InboundTrafficController.java	78.57%	3 Missing and 3 partials ⚠️
...c/main/java/com/linecorp/armeria/common/Flags.java	75.00%	1 Missing ⚠️
...p/armeria/internal/client/DecodedHttpResponse.java	83.33%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##               main    #6266      +/-   ##
============================================
+ Coverage     74.46%   74.57%   +0.11%     
- Complexity    22234    22476     +242     
============================================
  Files          1963     1985      +22     
  Lines         82437    83079     +642     
  Branches      10764    10787      +23     
============================================
+ Hits          61385    61957     +572     
- Misses        15918    15967      +49     
- Partials       5134     5155      +21     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[jrhee17]

Understood the main change is http2 flow control is updated when the request/response corresponding to the stream is consumed instead of immediately at onDataRead

[jrhee17]

Note: I understood that if users are not interested in the server request or client response (fire-and-forget pattern), then the window frame won't be sent.
ref: https://github.com/jrhee17/armeria/tree/poc/fire-and-forget

I think most users won't be using this pattern since, but something to keep in mind in case someone asks about this behavior after applying this patch.

[minwoox]

👍 👍 👍

[ikhoon]

if users are not interested in the server request or client response (fire-and-forget pattern)

From what I understand, Armeria requires users to consume all HttpResponses to avoid memory leaks.

[yzfeng2020]

hi @trustin could you review it, thanks!