Implement changes needed in the Host to decouple workers from the Host release #11111

surgupta-msft · 2025-06-09T19:38:46Z

Issue describing the changes in this PR

Related issue #10944

Update

As the PR now deals with multiple functionalities, splitting these changes into two separate PRs as described below. Additionally, converting this PR to a draft in case it’s needed for reference. I’ll close it when it’s no longer required.

Part1 -
- will focus on the refactoring aspect, specifically refactoring RPCWorkerConfigFactory and moving the logic for locating WorkerConfigs within the Host to a new class DefaultWorkerConfigurationResolver. This resolver will take its inputs via Options. These changes will be merged into the dev branch.
- PR - Refactor code to move the current logic to search for WorkerConfigs to a default worker configuration resolver #11229
Part2 -
- will contain the implementation of DynamicWorkerConfigurationResolver and include only the logic related to decoupling workers.
- PR - TBD

Pull request checklist

IMPORTANT: Currently, changes must be backported to the in-proc branch to be included in Core Tools and non-Flex deployments.

Backporting to the in-proc branch is not required
- Otherwise: Link to backporting PR
My changes do not require documentation changes
- Otherwise: Documentation issue linked to PR
My changes should not be added to the release notes for the next release
- Otherwise: I've added my notes to release_notes.md
My changes do not need to be backported to a previous version
- Otherwise: Backport tracked by issue/PR #issue_or_pr
My changes do not require diagnostic events changes
- Otherwise: I have added/updated all related diagnostic events and their documentation (Documentation issue linked to PR)
I have added all required tests (Unit tests, E2E tests)

Additional information

Additional PR information

This pull request introduces changes to decouple language workers from the Host release and enable dynamic worker resolution. Key updates include new worker configuration resolvers, environment enhancements, and feature flags to control worker behavior.

Backlog issues - Link
Design doc - Link

Flows covered in this PR -

RPCWorkerConfigFactory -
- Calls GetWorkerConfigs() method of IWorkerConfigurationResolver to get the required worker configs.
- Moved some methods to WorkerConfigurationHelper.cs to enable reusing of workers profile evaluation logic.
Resolving Worker Configurations -
- Added DefaultWorkerConfigurationResolver to scan the Host's "workers" directory for worker configurations.
- Introduced DynamicWorkerConfigurationResolver, which dynamically resolves worker configurations based on -
  - Environment settings and probing paths
  - Host-Worker compatibility check
  - Leveraging Release channel concept to point to a previous version of the worker
  - Fallback to the old flow if worker is not found at the probing path level
Environment Updates -
- Added IsWindowsEnvironment() to determine the windows environment type.
- Added IsDynamicWorkerResolutionEnabled method to EnvironmentExtensions class to enable/disable dynamic worker resolution using feature flag and hosting configuration.
- Added a new feature flag FeatureFlagDisableWorkerProbingPaths to disable dynamic resolution feature by users.
WorkerConfigurationResolverOptionsSetup -
- Configures WorkerConfigurationResolverOptions by getting required values from IConfiguration and IEnvironment such as worker probing paths, release channel, workers available for resolution via hosting config.

Note: The decoupling workers flow is disabled by default in this PR. We will enable the flow using Hosting Config after completing other relevant backlog items which will be included in follow-up PRs.

surgupta-msft · 2025-06-09T21:42:36Z

src/WebJobs.Script/Workers/Rpc/Configuration/RpcWorkerConfigFactory.cs

@@ -144,30 +176,16 @@ internal void AddProvider(string workerDir)

                    _logger.LogDebug("Found worker config: {workerConfigPath}", workerConfigPath);

-                    var workerConfig = GetWorkerConfigJsonElement(workerConfigPath);


No change in logic for this line. Just moved the method GetWorkerConfigJsonElement() to class WorkerConfigurationHelper

surgupta-msft · 2025-06-09T21:43:50Z

src/WebJobs.Script/Workers/Rpc/Configuration/RpcWorkerConfigFactory.cs

@@ -144,30 +176,16 @@ internal void AddProvider(string workerDir)

                    _logger.LogDebug("Found worker config: {workerConfigPath}", workerConfigPath);

-                    var workerConfig = GetWorkerConfigJsonElement(workerConfigPath);
-                    var workerDescriptionElement = workerConfig.GetProperty(WorkerConstants.WorkerDescription);


All these lines (148-170) are moved to a method WorkerConfigurationHelper.GetWorkerDescription() - https://gist.github.com/surgupta-msft/612906e464e445284eb8400a2695c087/revisions

surgupta-msft · 2025-06-09T21:45:29Z

src/WebJobs.Script/Workers/Rpc/Configuration/RpcWorkerConfigFactory.cs

@@ -213,61 +231,6 @@ internal void AddProvider(string workerDir)
            }
        }

-        private static JsonElement GetWorkerConfigJsonElement(string workerConfigPath)


These methods are also moved to class WorkerConfigurationHelper as we will need to call these methods from class WorkerConfigurationResolver as part of compatibility check

surgupta-msft · 2025-06-09T21:46:18Z

src/WebJobs.Script/Workers/Rpc/Configuration/WorkerConfigurationHelper.cs

+namespace Microsoft.Azure.WebJobs.Script.Workers.Rpc.Configuration
+{
+    internal static class WorkerConfigurationHelper
+    {


All the methods in this class are taken from RPCWorkerConfigFactory with minor adjustments. See gist - https://gist.github.com/surgupta-msft/fcecd60a676f9d7d73792c3a3dca9aa9/revisions

…ling-workers

test/TestWorkers/Probingpaths/workers/node/3.10.1/worker.config.json

src/WebJobs.Script/Workers/Rpc/Configuration/LanguageWorkerOptionsSetup.cs

liliankasem · 2025-07-08T00:16:13Z

Minor comment on branch name, we should use feature/ for feature branches as we have rules and CI setup for it (its protected) i.e. feature/decouple-workers

src/WebJobs.Script/Workers/Rpc/Configuration/DefaultWorkerConfigurationResolver.cs

src/WebJobs.Script/Workers/Rpc/Configuration/DynamicWorkerConfigurationResolver.cs

kshyju

Let's also add the placeholder + specialization use case test to validate that flow.

src/WebJobs.Script/Workers/Rpc/Configuration/WorkerConfigurationHelper.cs

src/WebJobs.Script/Workers/Rpc/Configuration/WorkerConfigurationResolverFactory.cs

src/WebJobs.Script/Workers/Rpc/IWorkerConfigurationResolver.cs

src/WebJobs.Script/Workers/Rpc/Configuration/DefaultWorkerConfigurationResolver.cs

src/WebJobs.Script/Workers/Rpc/Configuration/DynamicWorkerConfigurationResolver.cs

src/WebJobs.Script/Workers/Rpc/Configuration/LanguageWorkerOptionsSetup.cs

surgupta-msft · 2025-07-15T03:26:13Z

Let's also add the placeholder + specialization use case test to validate that flow.

Yes, this will definitely be included with Integration and E2E tests changes. I am currently working on it - #11140

src/WebJobs.Script/Environment/EnvironmentExtensions.cs

src/WebJobs.Script/Utility.cs

src/WebJobs.Script/Workers/Rpc/Configuration/LanguageWorkerOptionsSetup.cs

src/WebJobs.Script/Environment/EnvironmentExtensions.cs

src/WebJobs.Script/Workers/Rpc/Configuration/LanguageWorkerOptionsSetup.cs

src/WebJobs.Script/Workers/Rpc/Configuration/RpcWorkerConfigFactory.cs

…e/azure-functions-host into surgupta/decoupling-workers

src/WebJobs.Script.WebHost/WebHostServiceCollectionExtensions.cs

src/WebJobs.Script/Workers/Rpc/Configuration/WorkerConfigurationResolverOptions.cs

surgupta-msft added 20 commits May 25, 2025 18:02

Changes for Decoupling workers implementation

987fad0

Added test data for unit tests

734b029

Code cleanup and adding comments

cefdb92

Code refactoring to check probing paths enabled only once

021ac3e

Code refactoring

36abb61

Tests cleanup

8929697

Added test for LanguageWorkerOptionsSetup

1588711

Adding Tests for Utility class

2606f37

Adding more tests

08850c9

Changes in Tests

10d2e52

Updating LanguageWorkerOptionsSetupTests

95af17e

Minor refactoring and code cleanup

150aaf3

Fixing build warning

0def600

Fixing build issue in tests

cc3e044

Unit test fixing

26e8580

Stylecop fixes

9b6a945

Merge branch 'dev' into surgupta/decoupling-workers

e90ddda

Test data cleanup

ee60ec4

Test data cleanup

1495f31

Merge branch 'dev' into surgupta/decoupling-workers

c2628bb

surgupta-msft requested a review from a team as a code owner June 9, 2025 19:38

surgupta-msft commented Jun 9, 2025

View reviewed changes

Updated release notes

4ee497b

surgupta-msft changed the base branch from dev to surgupta/decouple-workers-feature June 11, 2025 05:39

surgupta-msft added 3 commits June 11, 2025 23:42

Merge branch 'surgupta/decouple-workers-feature' into surgupta/decoup…

c85ced3

…ling-workers

Renaming feature name

5168090

Updated tests

1ad3d14

liliankasem reviewed Jul 7, 2025

View reviewed changes

test/TestWorkers/Probingpaths/workers/node/3.10.1/worker.config.json Outdated Show resolved Hide resolved

liliankasem reviewed Jul 7, 2025

View reviewed changes

src/WebJobs.Script/Workers/Rpc/Configuration/LanguageWorkerOptionsSetup.cs Outdated Show resolved Hide resolved

liliankasem approved these changes Jul 8, 2025

View reviewed changes

surgupta-msft added 2 commits July 7, 2025 20:14

Test folder update

c6b9e93

Test folder name update

be527c4

surgupta-msft changed the base branch from surgupta/decouple-workers-feature to feature/decouple-workers July 8, 2025 01:16

Merge with main

aaf5243

brettsam reviewed Jul 8, 2025

View reviewed changes

src/WebJobs.Script/Workers/Rpc/Configuration/DefaultWorkerConfigurationResolver.cs Outdated Show resolved Hide resolved

src/WebJobs.Script/Workers/Rpc/Configuration/DynamicWorkerConfigurationResolver.cs Outdated Show resolved Hide resolved

Added some code comments

e0cb000

kshyju reviewed Jul 9, 2025

View reviewed changes

surgupta-msft added 4 commits July 8, 2025 23:23

Addressing PR feedback

738cea9

Log improvement

710ae35

Condition update to include placeholder mode

90e0ad2

Merge with main

b3a4045

surgupta-msft added 2 commits July 15, 2025 01:04

Test fix

fbb3c10

Merge with main

2936fa8

jviau reviewed Jul 28, 2025

View reviewed changes

surgupta-msft added 3 commits July 28, 2025 15:23

Improve WorkerConfigurationResolver to leverage Options pattern (#11203)

9f1a9af

Rebase with main

3825893

Merge branch 'surgupta/decoupling-workers' of https://github.com/Azur…

3681e57

…e/azure-functions-host into surgupta/decoupling-workers

surgupta-msft commented Jul 28, 2025

View reviewed changes

src/WebJobs.Script.WebHost/WebHostServiceCollectionExtensions.cs Show resolved Hide resolved

surgupta-msft added 3 commits July 28, 2025 17:43

code cleanup and added comments in resolver options class

2c2e8e3

Using Options to check if Dynamic worker resolution is enabled

779fd2d

Tests cleanup

4e03f80

surgupta-msft requested a review from kshyju July 29, 2025 15:25

Added WorkerConfigurationResolverOptionsSetupTests

e184c4f

kshyju reviewed Jul 30, 2025

View reviewed changes

src/WebJobs.Script/Workers/Rpc/Configuration/WorkerConfigurationResolverOptions.cs Show resolved Hide resolved

src/WebJobs.Script/Workers/Rpc/Configuration/WorkerConfigurationResolverOptions.cs Show resolved Hide resolved

surgupta-msft marked this pull request as draft August 1, 2025 19:04

		@@ -144,30 +176,16 @@ internal void AddProvider(string workerDir)

		_logger.LogDebug("Found worker config: {workerConfigPath}", workerConfigPath);

		var workerConfig = GetWorkerConfigJsonElement(workerConfigPath);

Implement changes needed in the Host to decouple workers from the Host release #11111

Are you sure you want to change the base?

Implement changes needed in the Host to decouple workers from the Host release #11111

Uh oh!

Conversation

surgupta-msft commented Jun 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Issue describing the changes in this PR

Update

Pull request checklist

Additional information

Uh oh!

surgupta-msft Jun 9, 2025

Choose a reason for hiding this comment

Uh oh!

surgupta-msft Jun 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

surgupta-msft Jun 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

surgupta-msft Jun 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

liliankasem commented Jul 8, 2025

Uh oh!

Uh oh!

Uh oh!

kshyju left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

surgupta-msft commented Jul 15, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

surgupta-msft commented Jun 9, 2025 •

edited

Loading

surgupta-msft Jun 9, 2025 •

edited

Loading

surgupta-msft Jun 9, 2025 •

edited

Loading

surgupta-msft Jun 9, 2025 •

edited

Loading