How to run Aspire inside a .NET SDK container?

[paulomorgado]

I tried something like this:

docker run --interactive --rm --network=host --add-host=host.docker.internal:host-gateway --volume C:\src\services-platform\connext\hub-PCNX-366:/host --volume /var/run/docker.sock:/var/run/docker.sock:rw --workdir /host --env HOME=/host --env Configuration --env CI_PIPELINE_ID --env CI_PROJECT_PATH --env CI_COMMIT_REF_NAME --env DOCKER_REGISTRY_API --env DOCKER_AUTH_USERNAME --env DOCKER_AUTH_PASSWORD --env DOTNET_CLI_TELEMETRY_OPTOUT=1 --env RunningOnContainer=true --env RepositoryBranch=feature/keycloak-PCNX-366 mcr.microsoft.com/dotnet/sdk:latest /bin/bash -c apt-get update; apt-get install -y ca-certificates curl; install -m 0755 -d /etc/apt/keyrings; curl -fsSL https://download.docker.com/linux/debian/gpg -o /etc/apt/keyrings/docker.asc; chmod a+r /etc/apt/keyrings/docker.asc; echo "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/debian $(. /etc/os-release && echo \"$VERSION_CODENAME\") stable" | tee /etc/apt/sources.list.d/docker.list; apt-get update; apt-get install -y docker-ce-cli; docker version; dotnet workload install aspire; dotnet run --launch-profile --project ./test/Aspire/My.TestsWithAspire

And got this error:

info: Aspire.Hosting.DistributedApplication[0]
      Aspire version: 8.0.2+3d0cf817f24298ba37bca94f15bd2f7061856e77
info: Aspire.Hosting.DistributedApplication[0]
      Distributed application starting.
info: Aspire.Hosting.DistributedApplication[0]
      Application host directory is: /host/test/Aspire/My.AppHost
info: Aspire.Hosting.Dcp.DcpHostService[0]
      Starting DCP with arguments: start-apiserver --monitor 594 --detach --kubeconfig "/tmp/aspire.nAYi26/kubeconfig"
info: Aspire.Hosting.Dcp.start-apiserver.api-server[0]
      Starting API server...
info: Aspire.Hosting.Dcp.start-apiserver.api-server[0]
      API server started        {"Address": "::1", "Port": 45305}
info: Aspire.Hosting.Dcp.start-apiserver.dcp-host[0]
      Starting DCP controller host
info: Aspire.Hosting.Dcp.start-apiserver.dcp-host[0]
      Started all services      {"count": 1}
info: Aspire.Hosting.Dcp.dcpctrl.IdeExecutableRunner[0]
      Executables cannot be started via IDE: missing required environment variable 'DEBUG_SESSION_PORT'
info: Aspire.Hosting.Dcp.dcpctrl[0]
      starting controller manager
fail: Aspire.Hosting.Dcp.dcpctrl.ContainerReconciler[0]
      could not create the container    {"Container": {"name":"mongodb_6de19533"}, "Reconciliation": 4, "error": "CreateContainer command returned error code 1 Stdout: '' Stderr: 'Error response from daemon: invalid mount config for type \"bind\": bind source path does not exist: /host/test/Aspire/My.AppHost/Database Scripts/Hub/MongoDB/init.js\n'"}
fail: Aspire.Hosting.Dcp.dcpctrl.ContainerReconciler[0]
      could not create the container    {"Container": {"name":"keycloak_6de19533"}, "Reconciliation": 3, "error": "CreateContainer command returned error code 1 Stdout: '' Stderr: 'Error response from daemon: invalid mount config for type \"bind\": bind source path does not exist: /host/test/Aspire/My.AppHost/Configuration\\Keycloak\n'"}
fail: Aspire.Hosting.Dcp.dcpctrl.ContainerReconciler[0]
      container has failed to start     {"Container": {"name":"mongodb_6de19533"}, "Reconciliation": 7, "error": "CreateContainer command returned error code 1 Stdout: '' Stderr: 'Error response from daemon: invalid mount config for type \"bind\": bind source path does not exist: /host/test/Aspire/My.AppHost/Database Scripts/Hub/MongoDB/init.js\n'"}
fail: Aspire.Hosting.Dcp.dcpctrl.ContainerReconciler[0]
      container has failed to start     {"Container": {"name":"keycloak_6de19533"}, "Reconciliation": 8, "error": "CreateContainer command returned error code 1 Stdout: '' Stderr: 'Error response from daemon: invalid mount config for type \"bind\": bind source path does not exist: /host/test/Aspire/My.AppHost/Configuration\\Keycloak\n'"}
info: Aspirant.Hosting.Testing.ResourceWatcher[0]
      Resource watcher started
info: Aspirant.Hosting.Testing.ResourceWatcher[0]
      Watching 3 resources for start/stop changes
info: Aspirant.Hosting.Testing.ResourceWatcher[0]
      Waiting on 3 resources to start
info: Aspirant.Hosting.Testing.ResourceWatcher[0]
      Resource 'mongodb_6de19533' of type 'MongoDBServerResource' changed state: [null] -> FailedToStart
info: Aspirant.Hosting.Testing.ResourceWatcher[0]
      Resource 'keycloak' of type 'KeycloakResource' changed state: [null] -> Hidden
info: Aspirant.Hosting.Testing.ResourceWatcher[0]
      Resource 'KeycloackAdminPassword' of type 'ParameterResource' changed state: [null] -> Hidden
info: Aspirant.Hosting.Testing.ResourceWatcher[0]
      Resource 'keycloak_6de19533' of type 'KeycloakResource' changed state: Hidden -> FailedToStart
info: Aspirant.Hosting.Testing.ResourceWatcher[0]
      Resource 'mongodb' of type 'MongoDBServerResource' changed state: FailedToStart -> Hidden
info: Aspirant.Hosting.Testing.ResourceWatcher[0]
      Resource 'KeycloackAdminUsername' of type 'ParameterResource' changed state: [null] -> Hidden
info: Aspirant.Hosting.Testing.ResourceWatcher[0]
      Resource 'visionbox-connext-hub-webservice' of type 'ProjectResource' changed state: [null] -> FailedToStart
info: Aspirant.Hosting.Testing.ResourceWatcher[0]
      All resources started
info: Aspirant.Hosting.Testing.ResourceWatcher[0]
      All resources stopped
info: Aspire.Hosting.DistributedApplication[0]
      Distributed application started. Press Ctrl+C to shut down.
info: Aspire.Hosting.Dcp.ApplicationExecutor[0]
      Could not stop project 'visionbox-connext-hub-webservice_6de19533'.
      k8s.Autorest.HttpOperationException: Operation returned an invalid status code 'NotFound', response body {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"executablereplicasets.usvc-dev.developer.microsoft.com \"visionbox-connext-hub-webservice_6de19533\" not found","reason":"NotFound","details":{"name":"visionbox-connext-hub-webservice_6de19533","group":"usvc-dev.developer.microsoft.com","kind":"executablereplicasets"},"code":404}

         at k8s.Kubernetes.SendRequestRaw(String requestContent, HttpRequestMessage httpRequest, CancellationToken cancellationToken) in /_/src/KubernetesClient/Kubernetes.cs:line 175
         at k8s.AbstractKubernetes.ICustomObjectsOperations_DeleteClusterCustomObjectWithHttpMessagesAsync[T](String group, String version, String plural, String name, V1DeleteOptions body, Nullable`1 gracePeriodSeconds, Nullable`1 orphanDependents, String propagationPolicy, String dryRun, IReadOnlyDictionary`2 customHeaders, CancellationToken cancellationToken) in /_/src/KubernetesClient/LibKubernetesGenerator/LibKubernetesGenerator.KubernetesClientSourceGenerator/CustomObjectsOperations.g.cs:line 1783
         at k8s.AbstractKubernetes.k8s.ICustomObjectsOperations.DeleteClusterCustomObjectWithHttpMessagesAsync(String group, String version, String plural, String name, V1DeleteOptions body, Nullable`1 gracePeriodSeconds, Nullable`1 orphanDependents, String propagationPolicy, String dryRun, IReadOnlyDictionary`2 customHeaders, CancellationToken cancellationToken) in /_/src/KubernetesClient/LibKubernetesGenerator/LibKubernetesGenerator.KubernetesClientSourceGenerator/CustomObjectsOperations.g.cs:line 1827
         at Aspire.Hosting.Dcp.KubernetesService.<>c__DisplayClass15_0`1.<<DeleteAsync>b__0>d.MoveNext() in /_/src/Aspire.Hosting/Dcp/KubernetesService.cs:line 159
      --- End of stack trace from previous location ---
         at Aspire.Hosting.Dcp.KubernetesService.ExecuteWithRetry[TResult](DcpApiOperationType operationType, String resourceType, Func`2 operation, CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/KubernetesService.cs:line 298
         at Aspire.Hosting.Dcp.ApplicationExecutor.DeleteResourcesAsync[RT](String resourceType, CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 1668
[xUnit.net 00:00:05.76]     VisionBox.ConneXt.Hub.BroadIntegrationTests.MessageDispatchTests.SentMessage_IsDeleiveredByDestination [FAIL]
  Failed VisionBox.ConneXt.Hub.BroadIntegrationTests.MessageDispatchTests.SentMessage_IsDeleiveredByDestination [5 s]
  Error Message:
   Aspire.Hosting.DistributedApplicationException : Resource 'mongodb' failed to start: FailedToStart
  Stack Trace:
     at VisionBox.ConneXt.Hub.BroadIntegrationTests.MessageDispatchTests.SentMessage_IsDeleiveredByDestination() in /host/test/VisionBox.ConneXt.Hub.BroadIntegrationTests/MessageDispatchTests.cs:line 47
   at VisionBox.ConneXt.Hub.BroadIntegrationTests.MessageDispatchTests.SentMessage_IsDeleiveredByDestination() in /host/test/VisionBox.ConneXt.Hub.BroadIntegrationTests/MessageDispatchTests.cs:line 111
--- End of stack trace from previous location ---
  Standard Output Messages:
 2024-07-08T18:58:55.0922661+00:00 info [Aspire.Hosting.DistributedApplication] Aspire version: 8.0.2+3d0cf817f24298ba37bca94f15bd2f7061856e77
 2024-07-08T18:58:55.0933760+00:00 info [Aspire.Hosting.DistributedApplication] Distributed application starting.
 2024-07-08T18:58:55.0935560+00:00 info [Aspire.Hosting.DistributedApplication] Application host directory is: /host/test/Aspire/My.AppHost
 2024-07-08T18:58:55.3309525+00:00 info [Aspire.Hosting.Dcp.DcpHostService] Starting DCP with arguments: start-apiserver --monitor 594 --detach --kubeconfig "/tmp/aspire.nAYi26/kubeconfig"
 2024-07-08T18:58:58.6746751+00:00 info [Aspire.Hosting.Dcp.start-apiserver.api-server] Starting API server...
 2024-07-08T18:58:58.6967882+00:00 info [Aspire.Hosting.Dcp.start-apiserver.api-server] API server started      {"Address": "::1", "Port": 45305}
 2024-07-08T18:58:58.6970633+00:00 info [Aspire.Hosting.Dcp.start-apiserver.dcp-host] Starting DCP controller host
 2024-07-08T18:58:58.6971221+00:00 info [Aspire.Hosting.Dcp.start-apiserver.dcp-host] Started all services      {"count": 1}
 2024-07-08T18:58:58.7360099+00:00 info [Aspire.Hosting.Dcp.dcpctrl.IdeExecutableRunner] Executables cannot be started via IDE: missing required environment variable 'DEBUG_SESSION_PORT'
 2024-07-08T18:58:58.7363766+00:00 info [Aspire.Hosting.Dcp.dcpctrl] starting controller manager
 2024-07-08T18:58:59.5469485+00:00 fail [Aspire.Hosting.Dcp.dcpctrl.ContainerReconciler] could not create the container {"Container": {"name":"mongodb_6de19533"}, "Reconciliation": 4, "error": "CreateContainer command returned error code 1 Stdout: '' Stderr: 'Error response from daemon: invalid mount config for type \"bind\": bind source path does not exist: /host/test/Aspire/My.AppHost/Database Scripts/Hub/MongoDB/init.js\n'"}
 2024-07-08T18:58:59.5482657+00:00 fail [Aspire.Hosting.Dcp.dcpctrl.ContainerReconciler] could not create the container {"Container": {"name":"keycloak_6de19533"}, "Reconciliation": 3, "error": "CreateContainer command returned error code 1 Stdout: '' Stderr: 'Error response from daemon: invalid mount config for type \"bind\": bind source path does not exist: /host/test/Aspire/My.AppHost/Configuration\\Keycloak\n'"}
 2024-07-08T18:59:00.0471264+00:00 fail [Aspire.Hosting.Dcp.dcpctrl.ContainerReconciler] container has failed to start  {"Container": {"name":"mongodb_6de19533"}, "Reconciliation": 7, "error": "CreateContainer command returned error code 1 Stdout: '' Stderr: 'Error response from daemon: invalid mount config for type \"bind\": bind source path does not exist: /host/test/Aspire/My.AppHost/Database Scripts/Hub/MongoDB/init.js\n'"}
 2024-07-08T18:59:00.0496883+00:00 fail [Aspire.Hosting.Dcp.dcpctrl.ContainerReconciler] container has failed to start  {"Container": {"name":"keycloak_6de19533"}, "Reconciliation": 8, "error": "CreateContainer command returned error code 1 Stdout: '' Stderr: 'Error response from daemon: invalid mount config for type \"bind\": bind source path does not exist: /host/test/Aspire/My.AppHost/Configuration\\Keycloak\n'"}
 2024-07-08T18:59:00.0707924+00:00 info [Aspirant.Hosting.Testing.ResourceWatcher] Resource watcher started
 2024-07-08T18:59:00.0715947+00:00 info [Aspirant.Hosting.Testing.ResourceWatcher] Watching 3 resources for start/stop changes
 2024-07-08T18:59:00.0743470+00:00 info [Aspirant.Hosting.Testing.ResourceWatcher] Waiting on 3 resources to start
 2024-07-08T18:59:00.0843107+00:00 info [Aspirant.Hosting.Testing.ResourceWatcher] Resource 'mongodb_6de19533' of type 'MongoDBServerResource' changed state: [null] -> FailedToStart
 2024-07-08T18:59:00.0847929+00:00 info [Aspirant.Hosting.Testing.ResourceWatcher] Resource 'keycloak' of type 'KeycloakResource' changed state: [null] -> Hidden
 2024-07-08T18:59:00.0848900+00:00 info [Aspirant.Hosting.Testing.ResourceWatcher] Resource 'KeycloackAdminPassword' of type 'ParameterResource' changed state: [null] -> Hidden
 2024-07-08T18:59:00.0849812+00:00 info [Aspirant.Hosting.Testing.ResourceWatcher] Resource 'keycloak_6de19533' of type 'KeycloakResource' changed state: Hidden -> FailedToStart
 2024-07-08T18:59:00.0850178+00:00 info [Aspirant.Hosting.Testing.ResourceWatcher] Resource 'mongodb' of type 'MongoDBServerResource' changed state: FailedToStart -> Hidden
 2024-07-08T18:59:00.0856154+00:00 info [Aspirant.Hosting.Testing.ResourceWatcher] Resource 'KeycloackAdminUsername' of type 'ParameterResource' changed state: [null] -> Hidden
 2024-07-08T18:59:00.0867531+00:00 Resource 'visionbox-connext-hub-webservice' log: Waiting for mongodb.
 2024-07-08T18:59:00.0869568+00:00 Resource 'visionbox-connext-hub-webservice' error: Failed to create resource visionbox-connext-hub-webservice
 System.Exception: Dependency mongodb failed to start
    at Aspirant.Hosting.WaitForDependenciesExtensions.WaitForDependenciesRunningHook.<>c__DisplayClass4_3.<<BeforeStartAsync>g__Wait|5>d.MoveNext() in /_/src/Aspirant.Hosting/WaitForDependencies/WaitForDependenciesExtensions.cs:line 118
 --- End of stack trace from previous location ---
    at Aspirant.Hosting.WaitForDependenciesExtensions.WaitForDependenciesRunningHook.<>c__DisplayClass4_1.<<BeforeStartAsync>b__2>d.MoveNext() in /_/src/Aspirant.Hosting/WaitForDependencies/WaitForDependenciesExtensions.cs:line 135
 --- End of stack trace from previous location ---
    at Aspire.Hosting.Dcp.ApplicationExecutor.CreateExecutableAsync(AppResource er, ILogger resourceLogger, CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 1182
    at Aspire.Hosting.Dcp.ApplicationExecutor.<CreateExecutablesAsync>g__CreateExecutableAsyncCore|51_0(AppResource cr, CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 1083
 2024-07-08T18:59:00.0871045+00:00 info [Aspirant.Hosting.Testing.ResourceWatcher] Resource 'visionbox-connext-hub-webservice' of type 'ProjectResource' changed state: [null] -> FailedToStart
 2024-07-08T18:59:00.0871614+00:00 info [Aspirant.Hosting.Testing.ResourceWatcher] All resources started
 2024-07-08T18:59:00.0871857+00:00 info [Aspirant.Hosting.Testing.ResourceWatcher] All resources stopped
 2024-07-08T18:59:00.0890177+00:00 info [Aspire.Hosting.DistributedApplication] Distributed application started. Press Ctrl+C to shut down.
 2024-07-08T18:59:00.1670332+00:00 info [Aspire.Hosting.Dcp.ApplicationExecutor] Could not stop project 'visionbox-connext-hub-webservice_6de19533'.
 k8s.Autorest.HttpOperationException: Operation returned an invalid status code 'NotFound', response body {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"executablereplicasets.usvc-dev.developer.microsoft.com \"visionbox-connext-hub-webservice_6de19533\" not found","reason":"NotFound","details":{"name":"visionbox-connext-hub-webservice_6de19533","group":"usvc-dev.developer.microsoft.com","kind":"executablereplicasets"},"code":404}

    at k8s.Kubernetes.SendRequestRaw(String requestContent, HttpRequestMessage httpRequest, CancellationToken cancellationToken) in /_/src/KubernetesClient/Kubernetes.cs:line 175
    at k8s.AbstractKubernetes.ICustomObjectsOperations_DeleteClusterCustomObjectWithHttpMessagesAsync[T](String group, String version, String plural, String name, V1DeleteOptions body, Nullable`1 gracePeriodSeconds, Nullable`1 orphanDependents, String propagationPolicy, String dryRun, IReadOnlyDictionary`2 customHeaders, CancellationToken cancellationToken) in /_/src/KubernetesClient/LibKubernetesGenerator/LibKubernetesGenerator.KubernetesClientSourceGenerator/CustomObjectsOperations.g.cs:line 1783
    at k8s.AbstractKubernetes.k8s.ICustomObjectsOperations.DeleteClusterCustomObjectWithHttpMessagesAsync(String group, String version, String plural, String name, V1DeleteOptions body, Nullable`1 gracePeriodSeconds, Nullable`1 orphanDependents, String propagationPolicy, String dryRun, IReadOnlyDictionary`2 customHeaders, CancellationToken cancellationToken) in /_/src/KubernetesClient/LibKubernetesGenerator/LibKubernetesGenerator.KubernetesClientSourceGenerator/CustomObjectsOperations.g.cs:line 1827
    at Aspire.Hosting.Dcp.KubernetesService.<>c__DisplayClass15_0`1.<<DeleteAsync>b__0>d.MoveNext() in /_/src/Aspire.Hosting/Dcp/KubernetesService.cs:line 159
 --- End of stack trace from previous location ---
    at Aspire.Hosting.Dcp.KubernetesService.ExecuteWithRetry[TResult](DcpApiOperationType operationType, String resourceType, Func`2 operation, CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/KubernetesService.cs:line 298
    at Aspire.Hosting.Dcp.ApplicationExecutor.DeleteResourcesAsync[RT](String resourceType, CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 1668



Failed!  - Failed:     1, Passed:     0, Skipped:     0, Total:     1, Duration: < 1 ms - VisionBox.ConneXt.Hub.BroadIntegrationTests.dll (net8.0)

Any hints?

[paulomorgado]

I was able to do the same test using TestContainers but using WithResourceMapping instead of WithBindMount.

WithResourceMapping "Copies a file or any binary content into the created container even before it is started."

Is there a way to do the same in Aspire?