Application Insights telemetry

[jelleholtkamp]

Hi,

I noticed that at the start of the run, it says that the program sends telemetry data to Application Insights. I looked through the docs, and I saw this in the reference section:

TelemetryEnableTrace
Allows you to submit trace to Application Insights to allow the development team to diagnose any issues that may be found. If you are submitting a support ticket then please include the Session GUID found in your log file for that run. This will help us find the problem.

Note: All exceptions that you encounter will surface inside of Visual Studio as the developers are working on the source. This will make sure that they tackle issues as they arise.

I'm not sure what exactly gets transmitted and when. Is it on by default? Can I completely disable it? And what exactly is transmitted? I'm looking to use this tool to perform a migration but due to the nature of the data that is migrated, can't really have private data transmitted to a third party.

[MrHinsh]

The tool collects telemetry on how long work items take to migrate, as well as errors an exceptions. There should be no work item content that is shared unless it results in an exception. In this case the value of the field that caused the exception would be shared. This is limited only to fields that have invalid data and to which the "BypassRule" flag does not apply.

No information is kept past 30 days.

Data that we do see:

• SessionID - This should be at the top of your log and can be used to allow our support team to find your exception and maybe help you debug without having to give us access to your environment. Each run of the tool generates a new session.
• Organisation Info: Name, Project, Work Item ID
• Exception information (samples below) - Field data is only shown in exceptions for fields that can have invalid data on save. Dates, Nodes (Area & Iteration Path). No text field data is ever sent.

SAMPLE EXCEPTION 1

Microsoft.TeamFoundation.TeamFoundationServerUnauthorizedException: TF30063: You are not authorized to access https://dev.azure.com/nkdagility-preview. ---> System.Net.WebException: The remote server returned an error: (401) Unauthorized. at System.Net.HttpWebRequest.GetResponse() at Microsoft.TeamFoundation.Client.Channels.TfsHttpWebRequest.SendRequestAndGetResponse(HttpWebRequest webRequest, WebException& webException) --- End of inner exception stack trace --- at Microsoft.TeamFoundation.Client.Channels.TfsHttpWebRequest.SendRequest() at Microsoft.TeamFoundation.Client.Channels.TfsHttpRequestChannel.Request(TfsMessage message, TimeSpan timeout) at Microsoft.TeamFoundation.Client.Channels.TfsHttpClientBase.Invoke(TfsClientOperation operation, Object[] parameters, TimeSpan timeout, Object[]& outputs) at Microsoft.TeamFoundation.WorkItemTracking.Proxy.ClientService.Update(XmlNode package, XmlNode& result, MetadataTableHaveEntry[] metadataHave, String& dbStamp, RowSetCollection& metadata) at Microsoft.TeamFoundation.WorkItemTracking.Proxy.WorkItemServer.Update(String requestId, XmlElement package, XmlElement& result, MetadataTableHaveEntry[] metadataHave, String& dbStamp, IMetadataRowSets& metadata) at Microsoft.TeamFoundation.WorkItemTracking.Client.WorkItemStore.SendUpdatePackage(XmlElement package, XmlElement& result, Boolean bulk) at Microsoft.TeamFoundation.WorkItemTracking.Client.WorkItemStore.SaveWorkItems(WorkItem[] workitems, Boolean bulk, SaveFlags saveFlags) at Microsoft.TeamFoundation.WorkItemTracking.Client.WorkItem.Save(SaveFlags saveFlags) at MigrationTools.TfsExtensions.SaveToAzureDevOps(WorkItemData context) in D:\a\1\s\src\MigrationTools.Clients.AzureDevops.ObjectModel\TfsExtensions.cs:line 76 at VstsSyncMigrator.Engine.WorkItemMigrationContext.ReplayRevisions(List`1 revisionsToMigrate, WorkItemData sourceWorkItem, WorkItemData targetWorkItem) in D:\a\1\s\src\VstsSyncMigrator.Core\Execution\MigrationContext\WorkItemMigrationContext.cs:line 563

SAMPLE EXCEPTION 2

Time	13:36:38
Exception type	Microsoft.TeamFoundation.WorkItemTracking.Client.FieldDefinitionNotExistException
Exception message	TF26027: A field definition Microsoft.VSTS.Common.AcceptanceCriteria in the work item type definition file does not exist. Add a definition for this field or remove the reference to the field and try again.
MachineName	5CG9056YLL
MessageTemplate	Field map fault
ProcessId	5848
SourceContext	MigrationTools.FieldMaps.AzureDevops.ObjectModel.FieldMergeMap
_MS.ProcessedByMetricExtractors	(Name:'Exceptions', Ver:'1.1')
currentWorkItem	1
sourceRevisionInt	2
sourceWorkItemId	15714
sourceWorkItemTypeName	Task
targetWorkItemId	null
Microsoft.TeamFoundation.WorkItemTracking.Client.FieldDefinitionNotExistException: TF26027: A field definition Microsoft.VSTS.Common.AcceptanceCriteria in the work item type definition file does not exist. Add a definition for this field or remove the reference to the field and try again.
   bij Microsoft.TeamFoundation.WorkItemTracking.Client.FieldDefinitionCollection.get_Item(String name)
   bij Microsoft.TeamFoundation.WorkItemTracking.Client.FieldCollection.get_Item(String name)
   bij MigrationTools.FieldMaps.AzureDevops.ObjectModel.FieldMergeMap.InternalExecute(WorkItem source, WorkItem target) in D:\a\1\s\src\MigrationTools.Clients.AzureDevops.ObjectModel\FieldMaps\FieldMergeMap.cs:regel 47
   bij MigrationTools.FieldMaps.AzureDevops.ObjectModel.FieldMapBase.Execute(WorkItemData source, WorkItemData target) in D:\a\1\s\src\MigrationTools.Clients.AzureDevops.ObjectModel\FieldMaps\FieldMapBase.cs:regel 31

EXAMPLE EXCEPTION 3

Time	13:36:37
Duration	106 ms
Outgoing command	POST /nkdagility-preview/WorkItemTracking/v8.0/ClientService.asmx
Result code	401
_MS.ProcessedByMetricExtractors	(Name:'Dependencies', Ver:'1.1')
https://dev.azure.com/nkdagility-preview/WorkItemTracking/v8.0/ClientService.asmx

Example Telemitery 1

Example Telemitery 2

[MrHinsh]

You can turn off telemetry from v13.2 by passing off as a value for --telemetry on the command line.

migration.exe --config configuration.json --telemetry off

This was added by PR #1634

[jelleholtkamp]

Thank you for the very detailed information!