Source built artifacts in UB do not correctly go through promotion pipeline

[mmitche]

The source-built artifacts appear to have incorrect metadata in the manifest, which leads to issues in promotion:

But the path to the artifact appears to be assets/release/dotnet-sdk-10.0.100-rc.1.25453.104-ubuntu.24.04-x64.tar.gz

The promotion process will attempt to download from artifact PipelineArtifactName at subpath PipelineArtifactPath. The subpath includes source-build, which appears incorrect.

[mmitche]

I think this might be related: Pipelines - Run 20250903.4 logs

    - script: |
        if [[ -d "$(Build.ArtifactStagingDirectory)/artifacts/assets/${{ parameters.configuration }}/source-build" ]]; then
          rm -rf $(Build.ArtifactStagingDirectory)/artifacts/assets/${{ parameters.configuration }}/source-build
        fi
      displayName: Clean up unwanted Source Build Artifacts
      continueOnError: true
      condition: succeededOrFailed()

What's designed to happen is that you say you want to publish an artifact and it should have some blob path. The publish task gets a base path where you're going to upload AzDO artifacts from, and it copies your artifact from the source file to the relative blob path under that base path

So:

1. Publish src/artifacts/release/bin/dotnet-sdk-blah.zip
2. dotnet-sdk-blah.zip should be at source-build/Sdks/dotnet-sdk-blah.zip in blob storage
3. Artifact staging location is /mnt/artifacts/release/
4. Copy src/artifacts/release/bin/dotnet-sdk-blah.zip to /mnt/artifacts/release/source-build/Sdks/dotnet-sdk-blah.zip
5. AzDO uploads all of /mnt/artifacts/release/

It looks like that step is deleting the source-build dir

[Winniexu01]

Hi @mmitche , based on your logic, files that have already been copied to the source-build path will no longer be published to https://ci.dot.net/public by the promotion pipeline. Therefore, as long as we ensure that other files are not downloaded from assets/Release/dotnet-sdk*.tar.gz / assets/Release/Private.SourceBuilt.Artifacts*.tar.gz path, but instead from the correct path: assets/Release/source-build/dotnet-sdk*.tar.gz / assets/Release/source-build/Private.SourceBuilt.Artifacts*.tar.gz or https://ci.dot.net/public/source-build/dotnet-sdk*.tar.gz / https://ci.dot.net/public/source-build/Private.SourceBuilt.Artifacts*.tar.gz , everything should work as expected. Is that correct?

[mthalman]

Fixed by dotnet/dotnet#2251