OpenTelemetry .NET Automatic Instrumentation: FileLoadException for OpenTelemetry.Instrumentation.Runtime, Version=1.11.1.410 Despite DLL Presence

[satishkumarnk-create]

I’m encountering a issue with a .NET 8 application (ClaimSubmissionService) running in a Kubernetes pod, using OpenTelemetry .NET Automatic Instrumentation (v1.11.0). The application does not send traces as it emits System.IO.FileLoadException for OpenTelemetry.Instrumentation.Runtime, Version=1.11.1.410, even though OpenTelemetry.Instrumentation.Runtime.dll is present in /otel-dotnet-auto/net. I need help resolving the version mismatch and the permission error to stabilize the pod.

Environment
Base Image: mcr.microsoft.com/dotnet/sdk:8.0.302-jammy (single-stage build)

OpenTelemetry Version: v1.11.0 (installed via otel-dotnet-auto-install.sh)

Kubernetes: AKS (version not specified, assume recent)

OS: Ubuntu 22.04 (Jammy, from base image)

.NET Runtime: .NET 8.0

Error Details
The pod crashes with the following error in /var/log/opentelemetry/dotnet/otel-dotnet-auto-1-ClaimSubmissionService.Api-StartupHook-20250427.log:

[2025-04-27T11:32:32.5366626Z] [Error] Error in StartupHook initialization: LoaderFolderLocation: /otel-dotnet-auto/net
Exception: Exception has been thrown by the target of an invocation.
System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation.
---> System.TypeInitializationException: The type initializer for 'OpenTelemetry.AutoInstrumentation.Loader.Loader' threw an exception.
---> System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation.
---> System.IO.FileLoadException: Could not load file or assembly 'OpenTelemetry.Instrumentation.Runtime, Version=1.11.1.410, Culture=neutral, PublicKeyToken=7bd6737fe5b67e3c'. Could not find or load a specific file. (0x80131621)
File name: 'OpenTelemetry.Instrumentation.Runtime, Version=1.11.1.410, Culture=neutral, PublicKeyToken=7bd6737fe5b67e3c'

However, OpenTelemetry.Instrumentation.Runtime.dll exists in /otel-dotnet-auto/net:

ls /otel-dotnet-auto/net

Microsoft.Extensions.Diagnostics.Abstractions.dll OpenTelemetry.Instrumentation.Process.dll
OpenTelemetry.Api.ProviderBuilderExtensions.dll OpenTelemetry.Instrumentation.Quartz.dll
OpenTelemetry.Api.dll OpenTelemetry.Instrumentation.Runtime.dll
OpenTelemetry.AutoInstrumentation.AspNetCoreBootstrapper.dll OpenTelemetry.Instrumentation.SqlClient.dll

[Kielek]

Linking with StackOverflow. Seems to be the same problem https://stackoverflow.com/questions/79595039/opentelemetry-net-automatic-instrumentation-fileloadexception-for-opentelemetr

[pjanotti]

SIG: is it possible to get a minimal repro?

[pjanotti]

SIG: closing the discussion due to the lack of repro.