How to collect k8s container log file(not stdout and stderr )

[fcfangcc]

How to collect k8s pod/container log files (not stdout and stderr )?

Like app write logs to container path /app/logs/test.log

I try to use kubernetes_logs, but it seems to only collect logs from /var/log/pods/

k8s container runtime: containerd/docker

Maybe config like:

sources:
  my_source_id:
    type: kubernetes_logs
    # like file source
    include:
      - /app/logs/*.log

Found real path like
/var/lib/docker/overlay2/9e048600f8da25798790333d8c0d128ba9a9f5c3110c530239fde2737ec0a1b8/diff/app/logs/xxx.log

[jszwedko]

I think the simplest way, aside from changing your app to write to stdout/stderr which I would recommend, if possible, would be to run Vector as a side-car container to your application container and mount a shared file system between them where the app writes to the log files and Vector can read them.

[fcfangcc]

Thank you for your reply.

This may be a little difficult.We have hundreds of applications.

Due to the performance problems of the existing collector, we are considering replacing the existing log collector with vector.

It is possible to get the real path. Is there a support plan for the community at present?

[jszwedko]

You could try leveraging the file source.

[fcfangcc]

That doesn't sound like a good fit for me

I'll try to implement that with vector