feat: EXP environment changes for Existing Resource Group & Fabric workspace #207
feat: EXP environment changes for Existing Resource Group & Fabric workspace #207Prajwal-Microsoft merged 108 commits intomainfrom
Conversation
Bumps [Newtonsoft.Json](https://github.com/JamesNK/Newtonsoft.Json) from 13.0.1 to 13.0.3. - [Release notes](https://github.com/JamesNK/Newtonsoft.Json/releases) - [Commits](JamesNK/Newtonsoft.Json@13.0.1...13.0.3) --- updated-dependencies: - dependency-name: Newtonsoft.Json dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Newtonsoft.Json](https://github.com/JamesNK/Newtonsoft.Json) from 13.0.1 to 13.0.3. - [Release notes](https://github.com/JamesNK/Newtonsoft.Json/releases) - [Commits](JamesNK/Newtonsoft.Json@13.0.1...13.0.3) --- updated-dependencies: - dependency-name: Newtonsoft.Json dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
…Configuration.Json, Microsoft.Extensions.Hosting, Microsoft.Extensions.Logging.Abstractions and System.Text.Json Bumps [Microsoft.Extensions.Configuration](https://github.com/dotnet/runtime), [Microsoft.Extensions.Configuration.Json](https://github.com/dotnet/runtime), [Microsoft.Extensions.Hosting](https://github.com/dotnet/runtime), [Microsoft.Extensions.Logging.Abstractions](https://github.com/dotnet/runtime) and [System.Text.Json](https://github.com/dotnet/runtime). These dependencies needed to be updated together. Updates `Microsoft.Extensions.Configuration` from 8.0.0 to 9.0.0 - [Release notes](https://github.com/dotnet/runtime/releases) - [Commits](dotnet/runtime@v8.0.0...v9.0.0) Updates `Microsoft.Extensions.Configuration.Json` from 8.0.0 to 9.0.0 - [Release notes](https://github.com/dotnet/runtime/releases) - [Commits](dotnet/runtime@v8.0.0...v9.0.0) Updates `Microsoft.Extensions.Hosting` from 8.0.0 to 9.0.0 - [Release notes](https://github.com/dotnet/runtime/releases) - [Commits](dotnet/runtime@v8.0.0...v9.0.0) Updates `Microsoft.Extensions.Logging.Abstractions` from 8.0.1 to 9.0.0 - [Release notes](https://github.com/dotnet/runtime/releases) - [Commits](dotnet/runtime@v8.0.1...v9.0.0) Updates `System.Text.Json` from 8.0.4 to 9.0.0 - [Release notes](https://github.com/dotnet/runtime/releases) - [Commits](dotnet/runtime@v8.0.4...v9.0.0) --- updated-dependencies: - dependency-name: Microsoft.Extensions.Configuration dependency-type: direct:production update-type: version-update:semver-major - dependency-name: Microsoft.Extensions.Configuration.Json dependency-type: direct:production update-type: version-update:semver-major - dependency-name: Microsoft.Extensions.Hosting dependency-type: direct:production update-type: version-update:semver-major - dependency-name: Microsoft.Extensions.Logging.Abstractions dependency-type: direct:production update-type: version-update:semver-major - dependency-name: System.Text.Json dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
…ns.Http Bumps [Microsoft.Extensions.Configuration](https://github.com/dotnet/runtime) and [Microsoft.Extensions.Http](https://github.com/dotnet/runtime). These dependencies needed to be updated together. Updates `Microsoft.Extensions.Configuration` from 8.0.0 to 9.0.0 - [Release notes](https://github.com/dotnet/runtime/releases) - [Commits](dotnet/runtime@v8.0.0...v9.0.0) Updates `Microsoft.Extensions.Http` from 8.0.1 to 9.0.0 - [Release notes](https://github.com/dotnet/runtime/releases) - [Commits](dotnet/runtime@v8.0.1...v9.0.0) --- updated-dependencies: - dependency-name: Microsoft.Extensions.Configuration dependency-type: direct:production update-type: version-update:semver-major - dependency-name: Microsoft.Extensions.Http dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Azure.Storage.Blobs](https://github.com/Azure/azure-sdk-for-net) from 12.22.2 to 12.23.0. - [Release notes](https://github.com/Azure/azure-sdk-for-net/releases) - [Commits](Azure/azure-sdk-for-net@Azure.Storage.Blobs_12.22.2...Azure.Storage.Blobs_12.23.0) --- updated-dependencies: - dependency-name: Azure.Storage.Blobs dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Azure.Storage.Blobs](https://github.com/Azure/azure-sdk-for-net) from 12.22.2 to 12.23.0. - [Release notes](https://github.com/Azure/azure-sdk-for-net/releases) - [Commits](Azure/azure-sdk-for-net@Azure.Storage.Blobs_12.22.2...Azure.Storage.Blobs_12.23.0) --- updated-dependencies: - dependency-name: Azure.Storage.Blobs dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Azure.Storage.Queues](https://github.com/Azure/azure-sdk-for-net) from 12.20.1 to 12.21.0. - [Release notes](https://github.com/Azure/azure-sdk-for-net/releases) - [Commits](Azure/azure-sdk-for-net@Azure.Storage.Queues_12.20.1...Azure.Storage.Queues_12.21.0) --- updated-dependencies: - dependency-name: Azure.Storage.Queues dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Newtonsoft.Json](https://github.com/JamesNK/Newtonsoft.Json) from 13.0.1 to 13.0.3. - [Release notes](https://github.com/JamesNK/Newtonsoft.Json/releases) - [Commits](JamesNK/Newtonsoft.Json@13.0.1...13.0.3) --- updated-dependencies: - dependency-name: Newtonsoft.Json dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [OpenTelemetry.Exporter.Console](https://github.com/open-telemetry/opentelemetry-dotnet) from 1.9.0 to 1.11.1. - [Release notes](https://github.com/open-telemetry/opentelemetry-dotnet/releases) - [Changelog](https://github.com/open-telemetry/opentelemetry-dotnet/blob/main/RELEASENOTES.md) - [Commits](open-telemetry/opentelemetry-dotnet@core-1.9.0...core-1.11.1) --- updated-dependencies: - dependency-name: OpenTelemetry.Exporter.Console dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [OpenTelemetry.Extensions.Hosting](https://github.com/open-telemetry/opentelemetry-dotnet) from 1.9.0 to 1.11.1. - [Release notes](https://github.com/open-telemetry/opentelemetry-dotnet/releases) - [Changelog](https://github.com/open-telemetry/opentelemetry-dotnet/blob/main/RELEASENOTES.md) - [Commits](open-telemetry/opentelemetry-dotnet@core-1.9.0...core-1.11.1) --- updated-dependencies: - dependency-name: OpenTelemetry.Extensions.Hosting dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net) from 1.13.0 to 1.13.2. - [Release notes](https://github.com/Azure/azure-sdk-for-net/releases) - [Commits](Azure/azure-sdk-for-net@Azure.Identity_1.13.0...Azure.Identity_1.13.2) --- updated-dependencies: - dependency-name: Azure.Identity dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [OpenTelemetry.Instrumentation.AspNetCore](https://github.com/open-telemetry/opentelemetry-dotnet-contrib) from 1.9.0 to 1.11.0. - [Release notes](https://github.com/open-telemetry/opentelemetry-dotnet-contrib/releases) - [Commits](open-telemetry/opentelemetry-dotnet-contrib@Exporter.Geneva-1.9.0...Resources.AWS-1.11.0) --- updated-dependencies: - dependency-name: OpenTelemetry.Instrumentation.AspNetCore dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net) from 1.13.0 to 1.13.2. - [Release notes](https://github.com/Azure/azure-sdk-for-net/releases) - [Commits](Azure/azure-sdk-for-net@Azure.Identity_1.13.0...Azure.Identity_1.13.2) --- updated-dependencies: - dependency-name: Azure.Identity dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
…y, Microsoft.KernelMemory.SemanticKernelPlugin, Microsoft.KernelMemory.WebClient and System.Linq.Async Bumps [Microsoft.Extensions.Configuration](https://github.com/dotnet/runtime), [Microsoft.KernelMemory](https://github.com/microsoft/kernel-memory), [Microsoft.KernelMemory.SemanticKernelPlugin](https://github.com/microsoft/kernel-memory), [Microsoft.KernelMemory.WebClient](https://github.com/microsoft/kernel-memory) and [System.Linq.Async](https://github.com/dotnet/reactive). These dependencies needed to be updated together. Updates `Microsoft.Extensions.Configuration` from 8.0.0 to 9.0.1 - [Release notes](https://github.com/dotnet/runtime/releases) - [Commits](dotnet/runtime@v8.0.0...v9.0.1) Updates `Microsoft.KernelMemory` from 0.90.241021.1 to 0.96.250120.1 - [Release notes](https://github.com/microsoft/kernel-memory/releases) - [Commits](microsoft/kernel-memory@packages-0.90.241021.1...packages-0.96.250120.1) Updates `Microsoft.KernelMemory.SemanticKernelPlugin` from 0.90.241021.1 to 0.96.250120.1 - [Release notes](https://github.com/microsoft/kernel-memory/releases) - [Commits](microsoft/kernel-memory@packages-0.90.241021.1...packages-0.96.250120.1) Updates `Microsoft.KernelMemory.WebClient` from 0.90.241021.1 to 0.96.250120.1 - [Release notes](https://github.com/microsoft/kernel-memory/releases) - [Commits](microsoft/kernel-memory@packages-0.90.241021.1...packages-0.96.250120.1) Updates `System.Linq.Async` from 6.0.1 to 6.0.1 - [Release notes](https://github.com/dotnet/reactive/releases) - [Commits](dotnet/reactive@ixnet-v6.0.1...ixnet-v6.0.1) --- updated-dependencies: - dependency-name: Microsoft.Extensions.Configuration dependency-type: direct:production update-type: version-update:semver-major - dependency-name: Microsoft.KernelMemory dependency-type: direct:production update-type: version-update:semver-minor - dependency-name: Microsoft.KernelMemory.SemanticKernelPlugin dependency-type: direct:production update-type: version-update:semver-minor - dependency-name: Microsoft.KernelMemory.WebClient dependency-type: direct:production update-type: version-update:semver-minor - dependency-name: System.Linq.Async dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net) from 1.13.0 to 1.13.2. - [Release notes](https://github.com/Azure/azure-sdk-for-net/releases) - [Commits](Azure/azure-sdk-for-net@Azure.Identity_1.13.0...Azure.Identity_1.13.2) --- updated-dependencies: - dependency-name: Azure.Identity dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Markdig](https://github.com/xoofx/markdig) from 0.37.0 to 0.40.0. - [Release notes](https://github.com/xoofx/markdig/releases) - [Changelog](https://github.com/xoofx/markdig/blob/master/changelog.md) - [Commits](xoofx/markdig@0.37.0...0.40.0) --- updated-dependencies: - dependency-name: Markdig dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Azure.Identity](https://github.com/Azure/azure-sdk-for-net) from 1.13.0 to 1.13.2. - [Release notes](https://github.com/Azure/azure-sdk-for-net/releases) - [Commits](Azure/azure-sdk-for-net@Azure.Identity_1.13.0...Azure.Identity_1.13.2) --- updated-dependencies: - dependency-name: Azure.Identity dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Microsoft.AspNetCore.OpenApi](https://github.com/dotnet/aspnetcore) from 8.0.10 to 8.0.13. - [Release notes](https://github.com/dotnet/aspnetcore/releases) - [Changelog](https://github.com/dotnet/aspnetcore/blob/main/docs/ReleasePlanning.md) - [Commits](dotnet/aspnetcore@v8.0.10...v8.0.13) --- updated-dependencies: - dependency-name: Microsoft.AspNetCore.OpenApi dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Microsoft.KernelMemory.Abstractions](https://github.com/microsoft/kernel-memory) from 0.90.241020.3 to 0.97.250211.1. - [Release notes](https://github.com/microsoft/kernel-memory/releases) - [Commits](microsoft/kernel-memory@packages-0.90.241020.3...packages-0.97.250211.1) --- updated-dependencies: - dependency-name: Microsoft.KernelMemory.Abstractions dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [System.Numerics.Tensors](https://github.com/dotnet/runtime) from 8.0.0 to 9.0.2. - [Release notes](https://github.com/dotnet/runtime/releases) - [Commits](dotnet/runtime@v8.0.0...v9.0.2) --- updated-dependencies: - dependency-name: System.Numerics.Tensors dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [MongoDB.Driver](https://github.com/mongodb/mongo-csharp-driver) from 2.25.0 to 3.2.1. - [Release notes](https://github.com/mongodb/mongo-csharp-driver/releases) - [Commits](mongodb/mongo-csharp-driver@v2.25.0...v3.2.1) --- updated-dependencies: - dependency-name: MongoDB.Driver dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Microsoft.Bcl.AsyncInterfaces](https://github.com/dotnet/runtime) from 8.0.0 to 9.0.2. - [Release notes](https://github.com/dotnet/runtime/releases) - [Commits](dotnet/runtime@v8.0.0...v9.0.2) --- updated-dependencies: - dependency-name: Microsoft.Bcl.AsyncInterfaces dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Microsoft.Extensions.Configuration](https://github.com/dotnet/runtime) from 8.0.0 to 9.0.2. - [Release notes](https://github.com/dotnet/runtime/releases) - [Commits](dotnet/runtime@v8.0.0...v9.0.2) --- updated-dependencies: - dependency-name: Microsoft.Extensions.Configuration dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
…esg-ai-doc-analysis/CFS.SK.Sustainability.AI/dependabotchanges/Microsoft.Extensions.Configuration-9.0.2 build: bump Microsoft.Extensions.Configuration from 8.0.0 to 9.0.2 in /Services/src/esg-ai-doc-analysis/CFS.SK.Sustainability.AI
…kernel-memory/clients/dotnet/SemanticKernelPlugin/dependabotchanges/Microsoft.Bcl.AsyncInterfaces-9.0.2 build: bump Microsoft.Bcl.AsyncInterfaces from 8.0.0 to 9.0.2 in /Services/src/kernel-memory/clients/dotnet/SemanticKernelPlugin
…esg-ai-doc-analysis/CFS.SK.Sustainability.AI/dependabotchanges/MongoDB.Driver-3.2.1 build: bump MongoDB.Driver from 2.25.0 to 3.2.1 in /Services/src/esg-ai-doc-analysis/CFS.SK.Sustainability.AI
…kernel-memory/clients/dotnet/SemanticKernelPlugin/dependabotchanges/System.Numerics.Tensors-9.0.2 build: bump System.Numerics.Tensors from 8.0.0 to 9.0.2 in /Services/src/kernel-memory/clients/dotnet/SemanticKernelPlugin
Bumps [Microsoft.Bcl.AsyncInterfaces](https://github.com/dotnet/runtime) from 9.0.2 to 9.0.3. - [Release notes](https://github.com/dotnet/runtime/releases) - [Commits](dotnet/runtime@v9.0.2...v9.0.3) --- updated-dependencies: - dependency-name: Microsoft.Bcl.AsyncInterfaces dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Microsoft.Extensions.Configuration](https://github.com/dotnet/runtime) from 8.0.0 to 9.0.2. - [Release notes](https://github.com/dotnet/runtime/releases) - [Commits](dotnet/runtime@v8.0.0...v9.0.2) --- updated-dependencies: - dependency-name: Microsoft.Extensions.Configuration dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
Bumps [Microsoft.SemanticKernel](https://github.com/microsoft/semantic-kernel) from 1.24.1 to 1.40.0. - [Release notes](https://github.com/microsoft/semantic-kernel/releases) - [Commits](microsoft/semantic-kernel@dotnet-1.24.1...dotnet-1.40.0) --- updated-dependencies: - dependency-name: Microsoft.SemanticKernel dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
feat: Down merge from main
feat: Down merge from main to dev
feat: EXP environment changes for Existing Resource Group & Fabric workspace
…mpty spaces in the Benchmark and Gap Analysis file
fix: Added validation to ensure that the name field does not accept empty spaces
docs: readme file updated
There was a problem hiding this comment.
Pull Request Overview
This PR enhances deployment flexibility by allowing reuse of existing Azure Resource Groups and Microsoft Fabric workspaces, updates project dependencies to newer versions, and refines deployment scripts and documentation.
- Parameterize Bicep templates and PowerShell scripts to accept existing resource group and environment inputs.
- Add a
resourcePrefix.bicephelper and updatedeployAzureResources.ps1for interactive RG selection. - Bump package versions across multiple projects from 8.x to 9.x (and related updates) and refine deployment docs.
Reviewed Changes
Copilot reviewed 13 out of 16 changed files in this pull request and generated 3 comments.
Show a summary per file
| File | Description |
|---|---|
| Services/src/kernel-memory/service/**/*.csproj | Updated dependency versions from 8.x to 9.x (various Microsoft.Extensions and other) |
| Deployment/scripts/resourcePrefix.bicep | New script to compute a consistent resource name prefix based on subscription & env |
| Deployment/scripts/deployAzureResources.ps1 | Script now prompts for RG and environment, supports creating or reusing an RG |
| Deployment/bicep/main_services.bicep | Removed RG creation resource, scoped modules to resourceGroup(), added parameters |
| Deployment/DeployFabric.md | Clarified step for creating or reusing an existing Fabric Lakehouse |
| Deployment/DeployAzureResources.md | Added guidance for specifying or auto-generating an RG and environment name |
Comments suppressed due to low confidence (3)
Deployment/bicep/main_services.bicep:1
- The file no longer contains the original license header; re-adding a license comment at the top helps maintain attribution and clarity on usage terms.
targetScope = 'resourceGroup'
Deployment/bicep/main_services.bicep:146
- [nitpick] Hardcoding the location limits flexibility; consider exposing the region as a parameter instead of using literal values like
'eastus'.
location: 'eastus'
Deployment/DeployFabric.md:27
- [nitpick] Using emphasis (
*) inside a Markdown header can render inconsistently; consider removing the italics markup to keep the header plain and clear.
## Step 1: *Create or Use an Existing Fabric Lakehouse
|
|
||
| # Check if the resource group exists | ||
| if (-not $resourceGroupName) { | ||
| Write-Host "Using provided resource group: $resourceGroupName" |
There was a problem hiding this comment.
[nitpick] The message is printed when $resourceGroupName is empty; consider moving or updating this line into the else block or changing it to reflect that no RG was provided.
| Write-Host "Using provided resource group: $resourceGroupName" | |
| Write-Host "No resource group name provided. A new resource group will be generated." -ForegroundColor Yellow |
| <PackageReference Include="Microsoft.Extensions.Logging.Abstractions" Version="8.0.1" /> | ||
| <PackageReference Include="Microsoft.Bcl.AsyncInterfaces" Version="9.0.3" /> | ||
| <PackageReference Include="Microsoft.Extensions.Configuration" Version="9.0.3" /> | ||
| <PackageReference Include="Microsoft.Extensions.Configuration.Json" Version="9.0.0" /> |
There was a problem hiding this comment.
[nitpick] This package version (9.0.0) does not match the 9.0.3 used for other Microsoft.Extensions.* dependencies; aligning them improves consistency.
| <PackageReference Include="Microsoft.Extensions.Configuration.Json" Version="9.0.0" /> | |
| <PackageReference Include="Microsoft.Extensions.Configuration.Json" Version="9.0.3" /> |
|
|
||
| + **Subscription ID** - Your Azure Subscription ID (copy/paste from the Azure portal). | ||
|
|
||
| + **Environment Name** - A unique environment name (e.g., dev, test, prod).This is used to scope resource names and group deployments logically. |
There was a problem hiding this comment.
Add a space after the period in prod).This to improve readability.
| + **Environment Name** - A unique environment name (e.g., dev, test, prod).This is used to scope resource names and group deployments logically. | |
| + **Environment Name** - A unique environment name (e.g., dev, test, prod). This is used to scope resource names and group deployments logically. |
Purpose
Resource Group Reuse
*Accept the existing Resource Group name as a parameter in the Bicep templates.
*Ensure Bicep scripts do not attempt to create the Resource Group if it already exists.
*Validate that all resources deploy into this specified Resource Group.
Fabric Workspace Reuse
*Accept the existing Microsoft Fabric Workspace details (ID or name) as an input parameter.
*Reference it in relevant components (e.g., if using Synapse, Data Factory, Power BI, etc.).
*Avoid creating a new Fabric Workspace in the template.
Does this introduce a breaking change?
Golden Path Validation
Deployment Validation
What to Check
Verify that the following are valid
Other Information