Exit status of vector when sink does not stop gracefully

[mans2singh]

Hi:

I am testing vector job in kubernetes using job workflow on aws eks cluster. When the eks cluster is updated and vector is not able to shutdown the sink, it kills the components as shown in the logs below. However, it looks like the job is marked a completed and pod is not restarted.

It looks like the relevant line is

vector/src/topology/running.rs

Line 146 in 8377429

error!(

.

I was trying to find out what is the exit status if the vector kills a component that cannot be shutdown gracefully.

Here are logs from vector:

2023-03-08T20:18:59.354456Z INFO vector::topology::running: Shutting down... Waiting on running components. remaining_components="my_sink" time_remaining="49 seconds left" 2023-03-08T20:19:04.355028Z INFO vector::topology::running: Shutting down... Waiting on running components. remaining_components="my_sink" time_remaining="44 seconds left" 2023-03-08T20:19:09.355224Z INFO vector::topology::running: Shutting down... Waiting on running components. remaining_components="my_sink" time_remaining="39 seconds left" 2023-03-08T20:19:14.354519Z INFO vector::topology::running: Shutting down... Waiting on running components. remaining_components="my_sink" time_remaining="34 seconds left" 2023-03-08T20:19:19.354853Z INFO vector::topology::running: Shutting down... Waiting on running components. remaining_components="my_sink" time_remaining="29 seconds left" 2023-03-08T20:19:24.356994Z INFO vector::topology::running: Shutting down... Waiting on running components. remaining_components="my_sink" time_remaining="24 seconds left" 2023-03-08T20:19:29.355147Z INFO vector::topology::running: Shutting down... Waiting on running components. remaining_components="my_sink" time_remaining="19 seconds left" 2023-03-08T20:19:34.354367Z INFO vector::topology::running: Shutting down... Waiting on running components. remaining_components="my_sink" time_remaining="14 seconds left" 2023-03-08T20:19:39.355347Z INFO vector::topology::running: Shutting down... Waiting on running components. remaining_components="my_sink" time_remaining="9 seconds left" 2023-03-08T20:19:44.355181Z INFO vector::topology::running: Shutting down... Waiting on running components. remaining_components="my_sink" time_remaining="4 seconds left" 2023-03-08T20:19:49.355508Z ERROR vector::topology::running: Failed to gracefully shut down in time. Killing components. components="my_sink"

[jszwedko]

Unfortunately it exits 0 still in that case. #13731 is tracking fixing that. Depending on your use-case, maybe your restart policy should restart Vector any time it exits rather than only when exiting non-zero?

[mans2singh]

Thanks for your response @jszwedko