Skip to content

Commit 9474102

Browse files
committed
Update recommended Kafka configuration
1 parent f22f173 commit 9474102

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

articles/event-hubs/apache-kafka-configurations.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ Property | Recommended Values | Permitted Range | Notes
2424
---|---:|---:|---
2525
`max.request.size` | 1000000 | < 1046528 | The service will close connections if requests larger than 1,046,528 bytes are sent. *This value **must** be changed and will cause issues in high-throughput produce scenarios.*
2626
`retries` | > 0 | | May require increasing delivery.timeout.ms value, see documentation.
27-
`request.timeout.ms` | 60000 | > 20000| Event Hubs will internally default to a minimum of 20,000 ms. *While requests with lower timeout values are accepted, client behavior isn't guaranteed.*. <p>Make sure that your **request.timeout.ms** is at least the recommended value of 60000 and your **session.timeout.ms** is at least the recommended value of 30000. Having these settings too low could cause consumer timeouts, which then cause rebalances (which then cause more timeouts, which cause more rebalancing, and so on).</p>
27+
`request.timeout.ms` | 30000 .. 60000 | > 20000| Event Hubs will internally default to a minimum of 20,000 ms. *While requests with lower timeout values are accepted, client behavior isn't guaranteed.*. <p>Make sure that your **request.timeout.ms** is at least the recommended value of 60000 and your **session.timeout.ms** is at least the recommended value of 30000. Having these settings too low could cause consumer timeouts, which then cause rebalances (which then cause more timeouts, which cause more rebalancing, and so on).</p>
2828
`metadata.max.idle.ms` | 180000 | > 5000 | Controls how long the producer will cache metadata for a topic that's idle. If the elapsed time since a topic was last produced exceeds the metadata idle duration, then the topic's metadata is forgotten and the next access to it will force a metadata fetch request.
2929
`linger.ms` | > 0 | | For high throughput scenarios, linger value should be equal to the highest tolerable value to take advantage of batching.
3030
`delivery.timeout.ms` | | | Set according to the formula (`request.timeout.ms` + `linger.ms`) * `retries`.
@@ -37,7 +37,7 @@ Property | Recommended Values | Permitted Range | Notes
3737
---|---:|-----:|---
3838
`heartbeat.interval.ms` | 3000 | | 3000 is the default value and shouldn't be changed.
3939
`session.timeout.ms` | 30000 |6000 .. 300000| Start with 30000, increase if seeing frequent rebalancing because of missed heartbeats.<p>Make sure that your request.timeout.ms is at least the recommended value of 60000 and your session.timeout.ms is at least the recommended value of 30000. Having these settings too low could cause consumer timeouts, which then cause rebalances (which then cause more timeouts, which cause more rebalancing, and so on).</p>
40-
40+
`max.poll.interval.ms` | 300000 (default) |>session.timeout.ms| Used for rebalance timeout, so this should not be set too low. Must be greater than session.timeout.ms.
4141

4242
## librdkafka configuration properties
4343
The main `librdkafka` configuration file ([link](https://github.com/edenhill/librdkafka/blob/master/CONFIGURATION.md)) contains extended descriptions for the properties below.
@@ -64,6 +64,7 @@ Property | Recommended Values | Permitted Range | Notes
6464
---|---:|-----:|---
6565
`heartbeat.interval.ms` | 3000 || 3000 is the default value and shouldn't be changed.
6666
`session.timeout.ms` | 30000 |6000 .. 300000| Start with 30000, increase if seeing frequent rebalancing because of missed heartbeats.
67+
`max.poll.interval.ms` | 300000 (default) |>session.timeout.ms| Used for rebalance timeout, so this should not be set too low. Must be greater than session.timeout.ms.
6768

6869

6970
## Further notes

0 commit comments

Comments
 (0)