Want to add custom logs for each retry

[sourabhrak19]

Question

I have an application that is built completely using vector. We are calling webhook API in sink to push the events. For the API, retry configs are all added. Whenever vector retries, it prints the attached logs. These logs are generic and also doesn't print the number of retries. There is no separate application code. It is just a bunch of source, transforms and sink files. In transform, I am adding some logs to identify for which ID transform was done like "Transform success for ID: 123". I also want to add a unique ID for which retry is happening like "Retrying for ID: 123, attempt: 3".

How to include these custom logs?

Vector version: vector 0.48.0

Vector Config

http-client.toml

type = "http"
inputs = [ "client-sink" ]
method = "post"
auth.strategy = "basic"
auth.user = "SECRET[client_username]"
auth.password = "SECRET[client_password]"
uri = "https://some.domain.com/users/event"
encoding.codec = "json"
batch.max_events = 1
request.retry_attempts = 5
request.retry_initial_backoff_secs = 1
request.retry_max_duration_secs = 3
request.timeout_secs = 3
framing.method = "bytes"
request.headers."Content-Type" = "application/json"
acknowledgements.enabled = true
buffer.max_events = 5000

Vector Logs

2025-11-13T08:07:27.398399Z ERROR sink{component_kind="sink" component_id=http-client component_type=http}:request{request_id=227}: vector::sinks::util::retries: Internal log [Not retriable; dropping the request.] has been suppressed 1 times.
2025-11-13T08:07:27.398410Z ERROR sink{component_kind="sink" component_id=http-client component_type=http}:request{request_id=227}: vector::sinks::util::retries: Not retriable; dropping the request. reason="Http status: 405 Method Not Allowed" internal_log_rate_limit=true
2025-11-13T08:07:27.398425Z ERROR sink{component_kind="sink" component_id=http-client component_type=http}:request{request_id=227}: vector_common::internal_event::service: Internal log [Service call failed. No retries or retries exhausted.] has been suppressed 1 times.
2025-11-13T08:07:27.398427Z ERROR sink{component_kind="sink" component_id=http-client component_type=http}:request{request_id=227}: vector_common::internal_event::service: Service call failed. No retries or retries exhausted. error=None request_id=227 error_type="request_failed" stage="sending"
2025-11-13T08:07:27.398440Z ERROR sink{component_kind="sink" component_id=http-client component_type=http}:request{request_id=227}: vector_common::internal_event::component_events_dropped: Internal log [Events dropped] has been suppressed 1 times.
2025-11-13T08:07:27.398443Z ERROR sink{component_kind="sink" component_id=http-client component_type=http}:request{request_id=227}: vector_common::internal_event::component_events_dropped: Events dropped intentional=false count=1 reason="Service call failed. No retries or retries exhausted."
2025-11-13T08:07:27.617965Z ERROR sink{component_kind="sink" component_id=http-client component_type=http}:request{request_id=228}: vector::sinks::util::retries: Internal log [Not retriable; dropping the request.] is being suppressed to avoid flooding.
2025-11-13T08:07:27.617986Z ERROR sink{component_kind="sink" component_id=http-client component_type=http}:request{request_id=228}: vector_common::internal_event::service: Internal log [Service call failed. No retries or retries exhausted.] is being suppressed to avoid flooding.
2025-11-13T08:07:27.617995Z ERROR sink{component_kind="sink" component_id=http-client component_type=http}:request{request_id=228}: vector_common::internal_event::component_events_dropped: Internal log [Events dropped] is being suppressed to avoid flooding.