Message not acknowledged: java.io.IOException: Timeout or no response waiting for NATS JetStream server: java.lang.RuntimeException: java.io.IOException: Timeout or no response waiting for NATS JetStream server

[s4iko]

Hi,

I sometimes got the exception "Message not acknowledged: java.io.IOException: Timeout or no response waiting for NATS JetStream server: java.lang.RuntimeException: java.io.IOException: Timeout or no response waiting for NATS JetStream server" but my Nats servers seems to be fine:

• CPU consumption of 60% max
• RAM consumption of 15% max
  I saw in the documentation there is a reconnection feature which append after 2s by default (https://docs.nats.io/using-nats/developer/connecting/reconnect). May this reconnection feature be the cause of a lost acknowledge request or response ?

Additional infos:

• nats jetstream deployed with the Helm chart on K8S
• CPU limit of 800m
• MEM limit of 1100m
• 3 nodes, no replica
• messages stored on a SSD
• using 4 µservices to process the data: µ1 => stream1 => µ2 => stream2 => µ3 => stream3 => µ4 => stream4

Streams after the data was loaded:

╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                    Stream Report                                                    │
├──────────────────────────────┬─────────┬──────────────┬───────────┬───────────┬─────────┬──────┬─────────┬──────────┤
│ Stream                       │ Storage │ Placement    │ Consumers │ Messages  │ Bytes   │ Lost │ Deleted │ Replicas │
├──────────────────────────────┼─────────┼──────────────┼───────────┼───────────┼─────────┼──────┼─────────┼──────────┤
│ Stream1                      │ File    │ tags: nats-0 │         1 │ 3,083,122 │ 3.9 GiB │ 0    │       0 │ nats-0*  │
│ Stream2                      │ File    │ tags: nats-1 │         1 │ 3,083,122 │ 4.5 GiB │ 0    │       0 │ nats-1*  │
│ Stream3                      │ File    │ tags: nats-2 │         1 │ 3,083,126 │ 4.7 GiB │ 0    │       0 │ nats-2*  │
│ Stream4                      │ File    │ tags: nats-3 │         0 │ 3,087,030 │ 4.9 GiB │ 0    │       0 │ nats-3*  │
╰──────────────────────────────┴─────────┴──────────────┴───────────┴───────────┴─────────┴──────┴─────────┴──────────╯

[s4iko]

I increased the connection timeout to 10s and did not get the exception anymore.