Distributed Tracing for Java Azure Functions - Duplicate logs in AI issue (#8915)

* Do not send user generated logs to AI and quick pulse service if the worker AI agent is enabled.

Author: RohitRanjanMS

release_notes.md

@@ -4,11 +4,12 @@
 - My change description (#PR)
 -->
 - Update Java Worker Version to [2.8.0](https://github.com/Azure/azure-functions-java-worker/releases/tag/2.8.0)
-
 - Track ApplicationInsights ingestion service response by subscribing to transmission event [PR](https://github.com/Azure/azure-functions-host/pull/8828)
 - Update ApplicationInsights packages to 2.21.0 (#8838)
 - Support model-type bindings for out-of-proc workers (#8815)
+- Fix the duplicate log issue with Java ApplicationInsights agent
 - Update Node.js Worker Version to [3.5.2](https://github.com/Azure/azure-functions-nodejs-worker/releases/tag/v3.5.2)
 
+
 **Release sprint:** Sprint 132
 [ [bugs](https://github.com/Azure/azure-functions-host/issues?q=is%3Aissue+milestone%3A%22Functions+Sprint+132%22+label%3Abug+is%3Aclosed) | [features](https://github.com/Azure/azure-functions-host/issues?q=is%3Aissue+milestone%3A%22Functions+Sprint+132%22+label%3Afeature+is%3Aclosed) ]

src/WebJobs.Script/ScriptHostBuilderExtensions.cs

@@ -411,6 +411,26 @@ internal static void ConfigureApplicationInsights(HostBuilderContext context, IL
                         o.EnableDependencyTracking = false;
                     });
                 }
+
+                builder.Services.AddOptions<LoggerFilterOptions>().Configure<IEnvironment>((options, environment) =>
+                {
+                    // Skip sending user generated logs to AI and QuickPulse if worker AI agent is configured, worker will send these logs to AI and Quickpulse service.
+                    if (environment.IsApplicationInsightsAgentEnabled())
+                    {
+                        options.AddFilter<ApplicationInsightsLoggerProvider>((category, logLevel) =>
+                        {
+                            // skip Function.<FunctionName>.User category
+                            if (!string.IsNullOrEmpty(category) && category.Length > 14 && category.EndsWith(".User", StringComparison.Ordinal))
+                            {
+                                return false;
+                            }
+                            else
+                            {
+                                return true;
+                            }
+                        });
+                    }
+                });
             }
         }