Add Aspire integration

[NikiforovAll]

Add Aspire integration for standalone mode.

builder.AddKernelMemory("km", port: 9001)
    .WithEnvironment("OPENAI_KEY", "");

[dluc]

hi @NikiforovAll I'm not sure I understand what the work to do would be. Is there something stopping from running KM with Aspire?

e.g. see #768

[NikiforovAll]

@Valkozaur Could you please share the source code, I would like to take a look at maybe help :)

I asked the initial questions because I was curious to know if there are any plans to add the Aspire Hosting package to the Kernel Memory repository.

[Valkozaur]

Hey, I've explained my findings in this stackoverflow issue:
https://stackoverflow.com/questions/78959886/azure-queueclient-error-when-connecting-to-host-docker-internal

[Valkozaur]

@NikiforovAll Have you had the time to play around, do you have any progress running kernel memory in aspire?

[NikiforovAll]

I've used it in the serverless mode so far - https://nikiforovall.github.io/dotnet/ai/2024/09/04/typical-rag-dotnet.html.

I have plans to try it in "As Service" mode

[Valkozaur]

With .NET9 and Aspire new docker network I managed to run Kernel Memory as a service locally.

[dluc]

Here's an example of KM with Qdrant:

var builder = DistributedApplication.CreateBuilder(args);

var qdrant = builder.AddContainer("qdrant", "qdrant/qdrant")
    .WithHttpEndpoint(targetPort: 6333)
    .PublishAsContainer();

var qdrantEndpoint = qdrant.GetEndpoint("http");

builder.AddProject<Projects.Service>("kernel-memory")
    .WaitFor(qdrant)
    .WithEnvironment("KernelMemory__TextGeneratorType", "AzureOpenAIText")
    .WithEnvironment("KernelMemory__DataIngestion__EmbeddingGeneratorTypes__0", "AzureOpenAIEmbedding")
    .WithEnvironment("KernelMemory__DataIngestion__MemoryDbTypes__0", "Qdrant")
    .WithEnvironment("KernelMemory__Retrieval__EmbeddingGeneratorType", "AzureOpenAIEmbedding")
    .WithEnvironment("KernelMemory__Retrieval__MemoryDbType", "Qdrant")
    .WithEnvironment("KernelMemory__Services__Qdrant__Endpoint", qdrantEndpoint)
    .WithEnvironment("KernelMemory__Services__Qdrant__APIKey", "")
    .WithEnvironment("KernelMemory__Services__AzureOpenAIText__Endpoint", "https://....openai.azure.com/")
    .WithEnvironment("KernelMemory__Services__AzureOpenAIText__Deployment", "gpt-4o")
    .WithEnvironment("KernelMemory__Services__AzureOpenAIEmbedding__Endpoint", "https://....openai.azure.com/")
    .WithEnvironment("KernelMemory__Services__AzureOpenAIEmbedding__Deployment", "text-embedding-ada-002");

builder.Build().Run();

[Valkozaur]

Yes, you can also use Blob Storage with Aspire without any issues. The problem with Aspire .NET 8 was the lack of a Docker network, causing everything to run on the host and resulting in a URL like https://host.docker.internal:1234/etc..., which broke the BlobStorage Client used by the SM service. This issue was resolved in .NET 9 and Aspire .NET 9.