Web app instantiation

[idlemind]

I'm creating a web app chat client using c# asp.net MVC. What's the most efficient way of instantiating and instance of the kernel per chat session? I doubt instantiating a new instance per web request is a great idea? Also, each chat session will a differing set of plugins and kernel.Data. Thanks

[dmytrostruk]

Hi @idlemind !

What's the most efficient way of instantiating and instance of the kernel per chat session? I doubt instantiating a new instance per web request is a great idea?

Kernel is a lightweight object, so it should be safe to initialize a new instance as Scoped (per request) or Transient (per object).

There is an extension method to easily add Kernel to your application, and we add it as Transient by default:

semantic-kernel/dotnet/src/SemanticKernel.Abstractions/Services/KernelServiceCollectionExtensions.cs

Lines 18 to 29 in e77ffdf

	public static IKernelBuilder AddKernel(this IServiceCollection services)
	{
	Verify.NotNull(services);
	// Register a KernelPluginCollection to be populated with any IKernelPlugins that have been
	// directly registered in DI. It's transient because the Kernel will store the collection
	// directly, and we don't want two Kernel instances to hold on to the same mutable collection.
	services.AddTransient<KernelPluginCollection>();
	// Register the Kernel as transient. It's mutable and expected to be mutated by consumers,
	// such as via adding event handlers, adding plugins, storing state in its Data collection, etc.
	services.AddTransient<Kernel>();

In your application you can add it to DI container like this:

var builder = WebApplication.CreateBuilder(args);

builder.Services.AddKernel();
builder.Services.AddOpenAIChatCompletion(openAIOptions.ChatModelId, openAIOptions.ApiKey);

Also, each chat session will a differing set of plugins and kernel.Data

If you will initialize Kernel instance per request or per object, it will have 0 imported plugins, so in each place you can import different set of plugins and have different kernel.Data property bag.

[idlemind]

Brilliant. Thanks for your reply!