feat(csharp/src/Drivers/Databricks): Implement Telemetry Reporting for Databricks

[jeremytang-db]

Created Telemetry models to fit Telemetry data in required format.
Uses ActivityListener to collect activities.

Still need to implement and check flag to enable and disable. Should be disabled by default.

[jadewang-db]

please add a readme file in this folder, on how is the file generated.

[jeremytang-db]

@birschick-bq Could you take a look at this PR? Especially with the logic in DatabricksActivityListener.cs.

[birschick-bq]

Thanks.

This is a start. I'll spend some more time on Wednesday to review.

[birschick-bq]

P.S. You should normally work on a feature branch and not main in your fork. This will make it easier to sync your main with the upstream repository. Let me know if you want a further explanation?

[jeremytang-db]

Thanks for your review. Please take a look again when you get the chance.

P.S. You should normally work on a feature branch and not main in your fork. This will make it easier to sync your main with the upstream repository. Let me know if you want a further explanation?

I see, is there a need to replace this PR?

[birschick-bq]

@jeremytang-db - I'm working on a change to allow the ActivitySource tags to be set. I'll also expose the ActivitySource.Name

[CurtHagenlocher]

Thanks for this large change! Can you please resolve the merge conflict (perhaps by rebasing)? And is there a specific reason for all the added types to be public? If not, could you please make them internal instead? They seem like the kind of implementation details that shouldn't be part of a public contract.

[jeremytang-db]

@CurtHagenlocher @birschick-bq @jadewang-db
Thanks for all the feedback. I believe I have addressed everything. Could you take another quick look when you get the chance?

[davidhcoe]

I don't think this should be included with the driver. We have OpenTelemetry implemented, and the way to get this is via the OTEL logger. This is basically forcing extra traffic (especially on the service side) that isn't needed.

[jeremytang-db]

Oh I was unaware of this. Can you point me to how to access the OTEL logger? Thank you!

[birschick-bq]

Hi Jeremy. Thanks. Here are a few more comments.

[birschick-bq]

@jeremytang-db - I see you updated the comments, but I don't see any new pushed commits. Do you any commits that aren't pushed yet? Is it on another branch?

[jeremytang-db]

@birschick-bq Sorry, I pushed to the wrong branch. It should be updated now.

[CurtHagenlocher]

The subject of client-side telemetry is often a contentious one. I think there should be an opt-out for it on the connection string.

Unrelated to that, there may have been a merge or rebase error as this doesn't currently appear to build.