[BUG]: DotNetCoreCLI@2 doesn't fail when asked to run tests that don't exist

[rolfbjarne]

New issue checklist

• I searched for existing GitHub issues
• I read pipeline troubleshooting guide
• I checked how to collect logs

Task name

DotNetCoreCLI@2

Task version

2

Issue Description

This:

- task: DotNetCoreCLI@2
  displayName: 'dotnet test'
  inputs:
    command: 'test'
    projects: garbage.dll

does not fail, instead it will warn with "Project file(s) matching the specified pattern were not found.".

I found multiple related issues where people have run into this unintuitive and dangerous behavior:

• [Question]: How to make DotNetCoreCLI@2 fail if Project file(s) not found? #20852 (no answer)
• DotnetCoreCLI task should fail when no tests are found #14232 (closed automatically after 180 days)
• dotnet Task: should exit with error if no project found? #3750 (someone says this should be fixed, a PR is opened, then closed for no apparent reason, then the issue is also closed for no apparent reason)

Environment type (Please select at least one enviroment where you face this issue)

• Self-Hosted
• Microsoft Hosted
• VMSS Pool
• Container

Azure DevOps Server type

dev.azure.com (formerly visualstudio.com)

Azure DevOps Server Version (if applicable)

No response

Operation system

All

Relevant log output

> ##[warning]Project file(s) matching the specified pattern were not found.

Full task logs with system.debug enabled

No response

Repro steps

[raujaiswal]

Hello @rolfbjarne ,
Thank you for bringing this to our attention.
We’ve created an internal work item to track this bug and will keep you updated as we make progress