tap-applicationinsights

[aleksas-lukauskas]

Is there a tap-applicationinsights available or planned?
I’m interested in extracting data from customEvents in Application Insights.
This would enable us to analyze application usage and business events tracked via Application Insights within our Meltano pipelines.

[edgarrmondragon]

Hi @aleksas-lukauskas 👋

You mean, for example, https://learn.microsoft.com/en-us/rest/api/application-insights/events/get?

The hardest part about developing for the MS platform is having access and setting up the credentials correctly, which is more annoying than difficult but still ...

[aleksas-lukauskas]

Hi @edgarrmondragon 👋

First of all, thank you for your quick response.

You mean, for example, learn.microsoft.com/en-us/rest/api/application-insights/events/get?

Yes, I believe so, but I’ll try to do some proper testing next week.

[aleksas-lukauskas]

Hey @edgarrmondragon

I verified whether the learn.microsoft.com/en-us/rest/api/application-insights/events/get returns the expected results, and I can confirm that it does.

However, it returns all the results without allowing you to filter or select specific attributes. That said, this might not be a limitation if filtering can be handled within the Meltano solution using tap-applicationinsights.

As an alternative it could be the Query endpoint.

This endpoint allows filtering and selecting attributes - including those in customDimensions (custom Attributes), like:
GET https://api.applicationinsights.io/v1/apps/{appId}/query?query=customEvents+%7C+extend+Result1_+%3D+tostring%28parse_json%28tostring%28customDimensions.Task1%29%29.Result1%29+%7C+where+timestamp+between%28datetime%282025-09-05T09%3A55%3A00Z%29..datetime%282025-09-07T10%3A00%3A00Z%29%29+%7C+where+Result1_+%3D%3D+%22ResultValue%22+%7C+project+timestamp%2C+Result_%2C+name%2C+customDimensions.{customDimension2}+%7C+order+by+timestamp+asc

However, I'm not sure which endpoint would be more suitable for the tap.

[aleksas-lukauskas]

I’m interested in extracting data from customEvents in Application Insights.

Just to clarify - I've just learned that in the future, it might be useful to retrieve more types of telemetry than customEvents, like Traces, Metrics, Requests, etc.