[processor] Is it possible to generate metrics from logs?

[zvrastil]

HIs it possible to write a custom processor that will process logs and generate new metrics from those logs? We have existing system that puts a lot of interesting metadata in some logs. We'd like to generate metrics from those logs on-the-fly.

Custom processor looks like a good way to do it, but it looks like processors are confined to their pipelines, so log processor can only mutate logs, but not create metrics from it. Or do I understand it wrong?

[garry-cairns]

I'm not a contributor but I think if you look at the spanmetrics processor it does something similar but with spans, and may be a good starting point for what you suggest.

[zvrastil]

Yes, that looks exactly as what I'm trying to achieve. So trace/log processor can feed metrics into the exporter of the metrics pipeline, as long as the metrics pipeline exists and its exporter is given to the processor as part of the configuration.

Thanks a lot!