Example of streaming S3 logs into a otel stack using a lambda based on a modified promtail.
At the time of writing opentelemetry go sdk logging support is still in progress so I've borrowed heavily from a separate PR so provide a functional otel logging SDK.
The CDK stands up a sample ALB access logging system with triggers oteltail via eventbridge notifications.
The oteltail should be capable of ingesting all the datasources originally supported by promtail e.g. SNS, SQL , Kinesis etc. Modifications have also been made to allow the ingest of custom datasources i.e. arbitrary json logs , however parsing of these logs is limited and left as a exercise for the ingesting system.
make cleanremove any intermediate statemake diffcompare deployed stack with current statemake deploydeploy this stack to your default AWS account/region