It seems like with the present configuration of the kubearmor receiver and the otel collector CRD, filtering is not happening, and all the logs including general messages and alerts are being sent to loki and then the same on grafana - for my setup the number goes to 3k-4k logs per batch sent.
more discussion here: https://kubearmor.slack.com/archives/C01FG4G2PEY/p1691559281078039
I have changed few things in the configuration files and it works for me, I am monitoring it a little more, will send a PR soon for discussion.