Does the new version support publishing speed limits at Broker level ?

[zhaoyajun2009]

Does the new version support publishing speed limits at Broker level ?

I config the brokerPublisherThrottlingMaxByteRate in broker.conf, But it is not working。

[lhotari]

Does the new version support publishing speed limits at Broker level ?

Yes, it is supported in 3.2.1 . Which version are you using?

I config the brokerPublisherThrottlingMaxByteRate in broker.conf, But it is not working。

How are you testing it? What's your expectation about the behavior and what's the actual behavior?

[zhaoyajun2009]

thank you, my version of using is v3.0.3.
My configuration methods are as follows which in broker.conf：
‘brokerPublisherThrottlingMaxMessageRate=’
‘maxPublishRatePerTopicInMessages=’
My expectation is that the rate of publishing is equial as my configuration in broker.conf.

[lhotari]

My configuration methods are as follows which in broker.conf：
‘brokerPublisherThrottlingMaxMessageRate=’
‘maxPublishRatePerTopicInMessages=’

did you set these to a specific value?

My expectation is that the rate of publishing is equial as my configuration in broker.conf.

How did you observe the rate of publishing? please share a specific example of expected value and actual value.

[lhotari]

thank you, my version of using is v3.0.3.

Please upgrade to v3.2.1 since it contains PIP-322: Pulsar Rate Limiting Refactoring. Earlier versions contain a lot of known issues referred to in PIP-322 docs and references.

[zhaoyajun2009]

brokerPublisherThrottlingMaxMessageRate=30
maxPublishRatePerTopicInMessages=70

the method of testing is ./bin/pulsar-perf produce test
but the result of the testing is as follows:
`_

2024-03-21T02:02:52,882+0800 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 393040 msg --- 99.8 msg/s --- 0.8 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 449.301 ms - med: 447.555 - 95pct: 897.415 - 99pct: 936.763 - 99.9pct: 944.619 - 99.99pct: 946.891 - Max: 946.891
2024-03-21T02:03:02,905+0800 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 394040 msg --- 99.8 msg/s --- 0.8 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 449.334 ms - med: 449.139 - 95pct: 898.159 - 99pct: 937.571 - 99.9pct: 947.087 - 99.99pct: 947.599 - Max: 947.599
2024-03-21T02:03:12,931+0800 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 395040 msg --- 99.8 msg/s --- 0.8 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 526.009 ms - med: 500.367 - 95pct: 1219.903 - 99pct: 1619.103 - 99.9pct: 1708.919 - 99.99pct: 1718.983 - Max: 1718.983
2024-03-21T02:03:22,956+0800 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 396040 msg --- 99.7 msg/s --- 0.8 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 448.982 ms - med: 449.949 - 95pct: 899.995 - 99pct: 939.599 - 99.9pct: 947.951 - 99.99pct: 951.547 - Max: 951.547
2024-03-21T02:03:32,982+0800 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 397040 msg --- 99.7 msg/s --- 0.8 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 487.679 ms - med: 482.389 - 95pct: 932.007 - 99pct: 1085.231 - 99.9pct: 1125.671 - 99.99pct: 1134.791 - Max: 1134.791
2024-03-21T02:03:43,006+0800 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 398040 msg --- 99.7 msg/s --- 0.8 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 451.920 ms - med: 450.421 - 95pct: 900.051 - 99pct: 940.215 - 99.9pct: 979.155 - 99.99pct: 989.255 - Max: 989.255
2024-03-21T02:03:53,030+0800 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 399040 msg --- 99.8 msg/s --- 0.8 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 448.487 ms - med: 449.539 - 95pct: 899.527 - 99pct: 937.867 - 99.9pct: 942.983 - 99.99pct: 952.363 - Max: 952.363
2024-03-21T02:04:03,074+0800 [main] INFO org.apache.pulsar.testclient.PerformanceProducer - Throughput produced: 400040 msg --- 99.8 msg/s --- 0.8 Mbit/s --- failure 0.0 msg/s --- Latency: mean: 825.360 ms - med: 689.811 - 95pct: 1991.751 - 99pct: 2241.567 - 99.9pct: 2331.439 - 99.99pct: 2341.503 - Max: 2341.503

_
`