Update matrix by nohwnd · Pull Request #15477 · microsoft/vstest

nohwnd · 2026-03-10T21:45:29Z

Description

Update versions. Look at how to do this automatically later.

Related issue

Copilot

Pull request overview

Updates the test/compatibility matrix by bumping framework/tooling versions and adjusting MSTest execution settings in test assets.

Changes:

Updated NUnit and MSTest version properties used by compatibility/test-asset builds.
Updated VSTest console version properties used for compatibility testing.
Added MSTest assembly-level parallelization configuration to two test asset projects.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

File	Description
test/TestAssets/MSTestProject2/UnitTest1.cs	Adds assembly-level MSTest parallelization configuration to influence test execution behavior.
test/TestAssets/MSTestProject1/UnitTest1.cs	Adds assembly-level MSTest parallelization configuration to influence test execution behavior.
eng/Versions.props	Bumps NUnit/MSTest/VSTest versions used by build/test compatibility matrices.

test/TestAssets/MSTestProject1/UnitTest1.cs

test/TestAssets/MSTestProject2/UnitTest1.cs

test/TestAssets/MSTestProject1/UnitTest1.cs

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

Copilot

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated 2 comments.

test/TestAssets/MSTestProject2/UnitTest1.cs

eng/Versions.props

nohwnd · 2026-03-11T13:33:58Z

needs #15480 where we are using only recent vstest.console to run compatibility checks on vstest.console, this avoids needing the old runtimes which we remove here.

(testhost does not need the runtime, because we pass runtime.config.json of the project, if someone is using netcoreapp2.1 that is their fault and they should update from this unsupported version of .NET)

nohwnd · 2026-03-11T13:34:20Z

The other errors I don't know yet. Need to merge stuff first, too many moving parts right now.

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

… update-matrix

Copilot

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated no new comments.

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

…stest into split-integration-tests

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

…stest into split-integration-tests

# Conflicts: # eng/build.ps1 # test/Microsoft.TestPlatform.Acceptance.IntegrationTests/TestCaseFilterTests.cs # test/Microsoft.TestPlatform.Library.IntegrationTests/AppDomainTests.cs # test/Microsoft.TestPlatform.Library.IntegrationTests/TranslationLayerTests/CodeCoverageTests.cs # test/Microsoft.TestPlatform.TestUtilities/IntegrationTestBuild.cs

Copilot

Pull request overview

Copilot reviewed 11 out of 11 changed files in this pull request and generated 3 comments.

Comments suppressed due to low confidence (1)

eng/build.ps1:1

If the caller already passed -properties as a single string, $PSBoundParameters['properties'] will be a string and += will concatenate into a single malformed value rather than append a new property entry. Consider normalizing to an array in both cases (e.g., wrap the existing value with @(...)) before appending, so the splatted -properties argument remains a proper list.

[CmdletBinding(PositionalBinding = $false)]

test/TestAssets/MSTestProject1/UnitTest1.cs

test/Microsoft.TestPlatform.Library.IntegrationTests/AppDomainTests.cs

src/vstest.console/TestPlatformHelpers/TestRequestManager.cs

nohwnd · 2026-03-16T13:56:16Z

eng/build.ps1

+    $PSBoundParameters['properties'] = @()
+  }
  $PSBoundParameters['properties'] += "/p:TestRunnerExternalArguments=$filterString $testParameterString"
-  Write-Host "Running tests with filter: $filterString and additional parameters: $testParameterString"


I added that in previous pr, it is not useful.

nohwnd · 2026-03-16T13:57:14Z

eng/Versions.props

@@ -89,30 +89,30 @@
    <XUnitFrameworkVersion>2.4.2</XUnitFrameworkVersion>


Updating xunit will be more pain probably, keeping for later.

nohwnd · 2026-03-16T13:58:42Z

aaaargh, it re-runs the build when I change it from draft. I always forget. It was almost green on mac tests....

Copilot

Pull request overview

Copilot reviewed 11 out of 11 changed files in this pull request and generated 3 comments.

test/TestAssets/MSTestProject2/UnitTest1.cs

eng/build.ps1

test/Microsoft.TestPlatform.Library.IntegrationTests/AppDomainTests.cs

Update matrix

ef58ac5

Copilot AI review requested due to automatic review settings March 10, 2026 21:45

Copilot AI reviewed Mar 10, 2026

View reviewed changes

test/TestAssets/MSTestProject1/UnitTest1.cs Outdated Show resolved Hide resolved

test/TestAssets/MSTestProject2/UnitTest1.cs Outdated Show resolved Hide resolved

test/TestAssets/MSTestProject1/UnitTest1.cs Outdated Show resolved Hide resolved

nohwnd and others added 2 commits March 10, 2026 22:57

Remove runtimes

6577f1c

Update test/TestAssets/MSTestProject2/UnitTest1.cs

f49a123

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

Copilot AI review requested due to automatic review settings March 11, 2026 07:30

Update test/TestAssets/MSTestProject1/UnitTest1.cs

4fb1487

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

Copilot AI reviewed Mar 11, 2026

View reviewed changes

test/TestAssets/MSTestProject2/UnitTest1.cs Show resolved Hide resolved

eng/Versions.props Outdated Show resolved Hide resolved

Merge branch 'main' into update-matrix

abafd3e

Update eng/Versions.props

fa5e4e1

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

Copilot AI review requested due to automatic review settings March 12, 2026 07:28

nohwnd added 2 commits March 12, 2026 08:30

Merge branch 'main' into update-matrix

ecc98a5

Merge branch 'update-matrix' of https://github.com/nohwnd/vstest into…

df97dfa

… update-matrix

Copilot AI reviewed Mar 12, 2026

View reviewed changes

nohwnd mentioned this pull request Mar 12, 2026

Wrapper compat provider not failing? #15482

Open

nohwnd and others added 13 commits March 12, 2026 13:20

Split tests

066c37d

Remove skip that is no longer needed

1bf48ba

wip

64bdcd9

move tests

691d24b

categories

e382b51

Update pipelines

a652910

Apply suggestions from code review

8b69e5b

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

Apply suggestion from @nohwnd

89a29eb

Apply suggestion from @nohwnd

4e72353

remove extra file

518e1a7

Merge branch 'split-integration-tests' of https://github.com/nohwnd/v…

cae5cf7

…stest into split-integration-tests

Potential fix for pull request finding

db85ed3

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

don't 'silently' skip

8dbe304

nohwnd added 11 commits March 13, 2026 14:27

Merge branch 'split-integration-tests' of https://github.com/nohwnd/v…

e70f464

…stest into split-integration-tests

speed up blame, and fix paralllization of tests that check process count

ce82579

Fix the flag

708f20c

fix typo in the parameter name

c25228f

Revert not filtering on linux

fe01823

missing runsettings

6f67ad8

Allow changing test runner arguments in proj

25269fa

Typo

87da2ca

Merge branch 'split-integration-tests' into update-matrix

4d71204

pr fixes

8501425

Copilot AI review requested due to automatic review settings March 16, 2026 11:51

Copilot AI reviewed Mar 16, 2026

View reviewed changes

test/TestAssets/MSTestProject1/UnitTest1.cs Show resolved Hide resolved

test/Microsoft.TestPlatform.Library.IntegrationTests/AppDomainTests.cs Show resolved Hide resolved

src/vstest.console/TestPlatformHelpers/TestRequestManager.cs Show resolved Hide resolved

Duplicated test

07c155a

nohwnd marked this pull request as ready for review March 16, 2026 13:55

Copilot AI review requested due to automatic review settings March 16, 2026 13:55

nohwnd commented Mar 16, 2026

View reviewed changes

Copilot AI reviewed Mar 16, 2026

View reviewed changes

test/TestAssets/MSTestProject2/UnitTest1.cs Show resolved Hide resolved

eng/build.ps1 Show resolved Hide resolved

test/Microsoft.TestPlatform.Library.IntegrationTests/AppDomainTests.cs Show resolved Hide resolved

Youssef1313 approved these changes Mar 16, 2026

View reviewed changes

nohwnd merged commit 056f792 into microsoft:main Mar 16, 2026
7 checks passed

		@@ -89,30 +89,30 @@
		<XUnitFrameworkVersion>2.4.2</XUnitFrameworkVersion>

Conversation

nohwnd commented Mar 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Related issue

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

nohwnd commented Mar 11, 2026

Uh oh!

nohwnd commented Mar 11, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

nohwnd Mar 16, 2026

Choose a reason for hiding this comment

Uh oh!

nohwnd Mar 16, 2026

Choose a reason for hiding this comment

Uh oh!

nohwnd commented Mar 16, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

nohwnd commented Mar 10, 2026 •

edited

Loading