Template engine tests hitting known parallelism issue in GetVisualStudioInstances

[marcpopMSFT]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=869444
Build error leg or test failing: Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewInstantiateTests.CanInstantiateTemplate_WithConditions_BasedOnFileName
Pull request: #44859

Error Message

{
  "ErrorMessage": "57005",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=869444
Error message validated: [57005]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 11/14/2024 7:41:30 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
1119349	dotnet/sdk	🟣 Build	Log	#50167
2767996	dotnet-sdk	OneLocBuild	Log
1118078	dotnet/sdk	Build	Log
1117540	dotnet/sdk	🟣 Run FullFramework Tests	Log	#50133
1117534	dotnet/sdk	Build	Log
1117321	dotnet/sdk	Run Tests in Helix	Log	#50123
1116976	dotnet/sdk	🟣 Run FullFramework Tests	Log	#49531
1116833	dotnet/sdk	🟣 Run FullFramework Tests	Log	#50114
1116509	dotnet/sdk	Build	Log	#50101
1116064	dotnet/sdk	🟣 Build	Log	#50063
1115732	dotnet/sdk	Build	Log	#50088
1115061	dotnet/sdk	Build	Log	#49835
1114288	dotnet/sdk	🟣 Run TestBuild Tests	Log	#49728
1113984	dotnet/sdk	Build	Log
1113654	dotnet/sdk	Build	Log
1113022	dotnet/sdk	🟣 Run TestBuild Tests	Log	#49556
1112341	dotnet/sdk	🟣 Run TestBuild Tests	Log	#49556
1110387	dotnet/sdk	🟣 Build	Log	#49728
1108011	dotnet/sdk	🟣 Run FullFramework Tests	Log	#49813
1106592	dotnet/sdk	🟣 Build	Log	#49948
1106237	dotnet/sdk	🟣 Build	Log	#49531
1104851	dotnet/sdk	🟣 Build	Log	#49905
2756516	dotnet-sdk	🟣 Build	Log
1103593	dotnet/sdk	🟣 Build	Log	#49847
1102548	dotnet/sdk	🟣 Build	Log	#49847
1101573	dotnet/sdk	🟣 Build	Log	#49721
2753415	dotnet-sdk	🟣 Run AoT Tests	Log
2753127	dotnet-sdk	Run TestBuild Tests	Log	#51709
2752712	dotnet-sdk	🟣 Run TestBuild Tests	Log
1098299	dotnet/sdk	🟣 Run FullFramework Tests	Log	#49847
1098230	dotnet/sdk	🟣 Build	Log	#49847
1097605	dotnet/sdk	🟣 Run ContainerBased Tests	Log	#49635
1097447	dotnet/sdk	🟣 Run ContainerBased Tests	Log	#49409
1096172	dotnet/sdk	🟣 Run FullFramework Tests	Log	#49740
2750704	dotnet-sdk	Checkout dotnet-sdk@refs/pull/51568/merge to s	Log	#51568
1094197	dotnet/sdk	Build	Log	#49773
1093481	dotnet/sdk	🟣 Build	Log	#49740

Build	Definition	Test	Pull Request
1118773	dotnet/sdk	Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.1.WorkItemExecution	#50149
1112396	dotnet/sdk	Microsoft.NET.Build.Tests.GivenThatWeWantToReferenceAnAssembly.Microsoft.NET.Build.Tests.GivenThatWeWantToReferenceAnAssembly.ItRunsAppsReferencingAProjectDirectlyReferencingAssemblies	#49556
1109188	dotnet/sdk	Microsoft.NET.Sdk.BlazorWebAssembly.Tests.WasmPublishIntegrationTest.Microsoft.NET.Sdk.BlazorWebAssembly.Tests.WasmPublishIntegrationTest.Publish_HostedApp_VisualStudio_WithSatelliteAssemblies	#49947
1106998	dotnet/sdk	Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewInstallTests.CanInstallToPathWithAt	#49947
1106868	dotnet/sdk	Microsoft.DotNet.Cli.New.IntegrationTests.DotnetNewInstallTests.CanInstallToPathWithAt	#49947
1102739	dotnet/sdk	Microsoft.NET.Sdk.BlazorWebAssembly.Tests.BlazorLegacyIntegrationTest60.Microsoft.NET.Sdk.BlazorWebAssembly.Tests.BlazorLegacyIntegrationTest60.Publish60Hosted_Works	#49740
1098206	dotnet/sdk	Microsoft.NET.Sdk.StaticWebAssets.Tests.dll.8.WorkItemExecution	#49800

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	13	44

[BrennanConroy]

Template engine tests hitting known parallelism issue in GetVisualStudioInstances

Is there an issue describing the problem? Are there people working on fixing it? We're hitting this in the aspnetcore repo a lot and as far as I'm aware we don't do anything with UWP which is how the sdk resolved the problem.

[baronfel]

@jaredpar sent a PR here with a short-term workaround that we're working to merge: #44930

The 'true' fix is coming in a future VS release, there was some unintended concurrent access to a critical section that wasn't locked.