Merge branch 'hotfix' into UT-10888-backend

Author: Roopan-Microsoft

README.md

@@ -1,4 +1,4 @@
-# Multi-Agent: Custom Automation Engine – Solution Accelerator
+# Multi-Agent-Custom-Automation-Engine – Solution Accelerator
 
 MENU: [**USER STORY**](#user-story) \| [**QUICK DEPLOY**](#quick-deploy)  \| [**SUPPORTING DOCUMENTATION**](#supporting-documentation) \|
 
@@ -13,23 +13,23 @@ Problem:
 Agentic AI systems are set to transform the way businesses operate, however it can be fairly complex to build an initial MVP to demonstrate this value. 
 
 Solution:
-The Multi-Agent -Custom Automation Engine Solution Accelerator provides a ready to go application to use as the base of the MVP, or as a reference, allowing you to hit the ground running.
+The Multi-Agent-Custom Automation Engine Solution Accelerator provides a ready to go application to use as the base of the MVP, or as a reference, allowing you to hit the ground running.
 
 ### Technology Note
 This accelerator uses the AutoGen framework from Microsoft Research.  This is an open source project that is maintained by [Microsoft Research’s AI Frontiers Lab](https://www.microsoft.com/research/lab/ai-frontiers/). Please see this [blog post](https://devblogs.microsoft.com/autogen/microsofts-agentic-frameworks-autogen-and-semantic-kernel/) for the latest information on using the AutoGen framework in production solutions.
 
 ### Use cases / scenarios
 The multi-agent approach allows users to utilize multiple AI agents simultaneously for repeatable tasks, ensuring consistency and efficiency. 
-The agents collaborate with a manager on various assignments for onboarding a new employee , such as HR and tech support AI working together to set up software accounts, configure hardware, schedule onboarding meetings, register employees for benefits, and send welcome emails. Additionally, these agents can handle tasks like procurement and drafting press releases.
+The agents collaborate with a manager on various assignments for onboarding a new employee, such as HR and tech support AI working together to set up software accounts, configure hardware, schedule onboarding meetings, register employees for benefits, and send welcome emails. Additionally, these agents can handle tasks like procurement and drafting press releases.
 
 ### Business value
-Multi-agent systems represent the next wave of Generative AI use cases, offering entirely new opportunities to drive efficiencies in your business. The Multi-Agent -Custom Automation Engine Solution Accelerator demonstrates several key benefits:
+Multi-agent systems represent the next wave of Generative AI use cases, offering entirely new opportunities to drive efficiencies in your business. The Multi-Agent-Custom-Automation-Engine Solution Accelerator demonstrates several key benefits:
 
 - **Allows people to focus on what matters:** by doing the heavy lifting involved with coordinating activities across an organization, peoples’ time is freed up to focus on their specializations.
 - **Enabling GenAI to scale:** by not needing to build one application after another, organizations are able to reduce the friction of adopting GenAI across their entire organization. One capability can unlock almost unlimited use cases.
 - **Applicable to most industries:** these are common challenges that most organizations face, across most industries.
 
-Whilst still an emerging area, investing in agentic use cases, digitatization and developing tools will be key to ensuring you are able to leverage these new technologies and seize the GenAI moment.
+Whilst still an emerging area, investing in agentic use cases, digitization and developing tools will be key to ensuring you are able to leverage these new technologies and seize the GenAI moment.
 
 ### Technical key features
 
@@ -185,10 +185,10 @@ To add your newly created backend image:
 To add the new container to your website run the following:
 
 ```
-az webapp config container set --resource-group macae_full_deploy2_rg \
---name macae-frontend-2t62qyozi76bs \
---container-image-name macaeacr2t62qyozi76bs.azurecr.io/frontendmacae:latest  \
---container-registry-url https://macaeacr2t62qyozi76bs.azurecr.io
+az webapp config container set --resource-group <resource_group_name> \
+--name <container_name> \
+--container-image-name <e.g. macaeacr2t62qyozi76bs.azurecr.io/frontendmacae:latest>  \
+--container-registry-url <e.g. https://macaeacr2t62qyozi76bs.azurecr.io>
 ```
 
 
@@ -199,7 +199,7 @@ To add the identity provider, please follow the steps outlined in [Set Up Authen
 
 To debug the solution, you can use the Cosmos and OpenAI services you have manually deployed.  To do this, you need to ensure that your Azure identity has the required permissions on the Cosmos and OpenAI services. 
 
-- For OpeAI service, you can add yourself to the ‘Cognitive Services OpenAI User’ permission in the Access Control (IAM) pane of the Azure portal.  
+- For OpenAI service, you can add yourself to the ‘Cognitive Services OpenAI User’ permission in the Access Control (IAM) pane of the Azure portal.  
 - Cosmos is a little more difficult as it requires permissions be added through script.  See these examples for more information: 
   - [Use data plane role-based access control - Azure Cosmos DB for NoSQL | Microsoft Learn](https://learn.microsoft.com/en-us/azure/cosmos-db/nosql/security/how-to-grant-data-plane-role-based-access?tabs=built-in-definition%2Cpython&pivots=azure-interface-cli) 
   - [az cosmosdb sql role assignment | Microsoft Learn](https://learn.microsoft.com/en-us/cli/azure/cosmosdb/sql/role/assignment?view=azure-cli-latest#az-cosmosdb-sql-role-assignment-create) 

TRANSPARENCY_FAQS.md

@@ -1,4 +1,4 @@
-# Multi-Agent: Custom Automation Engine – Solution Accelerator : Responsible AI FAQ 
+# Multi-Agent-Custom-Automation-Engine – Solution Accelerator : Responsible AI FAQ 
 
 ## What is the Multi Agent: Custom Automation Engine – Solution Accelerator? 
 Multi Agent: Custom Automation Engine – Solution Accelerator is an open-source GitHub Repository that enables users to solve complex tasks using multiple agents. The accelerator is designed to be generic across business tasks.  The user enters a task and a planning LLM formulates a plan to complete that task.  The system then dynamically generates agents which can complete the task.  The system also allows the user to create actions that agents can take (for example sending emails or scheduling orientation sessions for new employees).  These actions are taken into account by the planner and dynamically created agents may be empowered to take these actions.

documentation/LocalDeployment.md

@@ -22,7 +22,7 @@
      ```
    - To specify a tenant, use:
      ```bash
-     az login --tenant 16b3c013-0000-0000-0000-000000000
+     az login --tenant <tenant_id>
      ```
 
 3. **Create a Resource Group:**
@@ -42,29 +42,47 @@
      ```bash
      az ad signed-in-user show --query id -o tsv
      ```
-     You will also be prompted for locations for Cosmos and Open AI services.  This is to allow separate regions where there may be service quota restrictions
+     You will also be prompted for locations for Cosmos and Open AI services.  This is to allow separate regions where there may be service quota restrictions.
 
-5. **Create a `.env` file:**
+   - **Additional Notes**:
+
+     **Role Assignments in Bicep Deployment:**
+     
+      The **macae-dev.bicep** deployment includes the assignment of the appropriate roles to AOAI and Cosmos services. If you want to modify an existing implementation—for example, to use resources deployed as part of the simple deployment for local debugging—you will need to add your own credentials to access the Cosmos and AOAI services. You can add these permissions using the following commands:
+     ```bash
+     az cosmosdb sql role assignment create --resource-group <solution-accelerator-rg> --account-name <cosmos-db-account-name> --role-definition-name "Cosmos DB Built-in Data Contributor" --principal-id <aad-user-object-id> --scope /subscriptions/<subscription-id>/resourceGroups/<solution-accelerator-rg>/providers/Microsoft.DocumentDB/databaseAccounts/<cosmos-db-account-name>
+     ```
+
+     ```bash
+     az role assignment create --assignee <aad-user-upn> --role "Cognitive Services OpenAI User" --scope /subscriptions/<subscription-id>/resourceGroups/<solution-accelerator-rg>/providers/Microsoft.CognitiveServices/accounts/<azure-openai-account-name>
+     ```
+      **Using a Different Database in Cosmos:**
+
+      You can set the solution up to use a different database in Cosmos. For example, you can name it something like autogen-dev. To do this:
+		1. Change the environment variable **COSMOSDB_DATABASE** to the new database name.
+ 		2. You will need to create the database in the Cosmos DB account. You can do this from the Data Explorer pane in the portal, click on the drop down labeled “_+ New Container_” and provide all the necessary details.
+
+6. **Create a `.env` file:**
 
    - Navigate to the `src` folder and create a `.env` file based on the provided `.env.sample` file.
 
-6. **Fill in the `.env` file:**
+7. **Fill in the `.env` file:**
 
    - Use the output from the deployment or check the Azure Portal under "Deployments" in the resource group.
 
-7. **(Optional) Set up a virtual environment:**
+8. **(Optional) Set up a virtual environment:**
 
    - If you are using `venv`, create and activate your virtual environment for both the frontend and backend folders.
 
-8. **Install requirements - frontend:**
+9. **Install requirements - frontend:**
 
    - In each of the frontend and backend folders -
      Open a terminal in the `src` folder and run:
      ```bash
      pip install -r requirements.txt
      ```
 
-9. **Run the application:**
+10. **Run the application:**
    - From the src/backend directory:
    ```bash
    python app.py

documentation/azure_app_service_auth_setup.md

@@ -18,7 +18,7 @@
 
 ![Add Provider](./images/azure-app-service-auth-setup/AppAuthIdentityProviderAdd.png)
 
-5. Accept the default values and click on `Add` button to go back to the previous page with the identify provider added.
+5. Accept the default values and click on `Add` button to go back to the previous page with the idenity provider added.
 
 ![Add Provider](./images/azure-app-service-auth-setup/AppAuthIdentityProviderAdded.png)
 

src/backend/.env.sample

@@ -3,6 +3,7 @@ COSMOSDB_DATABASE=autogen
 COSMOSDB_CONTAINER=memory
 
 AZURE_OPENAI_ENDPOINT=
+AZURE_OPENAI_MODEL_NAME=gpt-4o
 AZURE_OPENAI_DEPLOYMENT_NAME=gpt-4o
 AZURE_OPENAI_API_VERSION=2024-08-01-preview
 APPLICATIONINSIGHTS_INSTRUMENTATION_KEY=

src/backend/agents/group_chat_manager.py

@@ -305,12 +305,12 @@ async def _execute_step(self, session_id: str, step: Step):
         )
 
         track_event_if_configured(
-            f"Group Chat Manager - Requesting {step.agent.value.title()} to perform the action and added into the cosmos",
+            f"Group Chat Manager - Requesting {formatted_agent} to perform the action and added into the cosmos",
             {
                 "session_id": session_id,
                 "user_id": self._user_id,
                 "plan_id": step.plan_id,
-                "content": f"Requesting {step.agent.value.title()} to perform action: {step.action}",
+                "content": f"Requesting {formatted_agent} to perform action: {step.action}",
                 "source": "GroupChatManager",
                 "step_id": step.id,
             },

src/backend/app.py

@@ -23,6 +23,7 @@
 from src.backend.event_utils import track_event_if_configured
 from fastapi.middleware.cors import CORSMiddleware
 from azure.monitor.opentelemetry import configure_azure_monitor
+from opentelemetry.instrumentation.fastapi import FastAPIInstrumentor
 
 
 # Check if the Application Insights Instrumentation Key is set in the environment variables
@@ -52,6 +53,8 @@
 # Initialize the FastAPI app
 app = FastAPI()
 
+FastAPIInstrumentor.instrument_app(app)
+
 frontend_url = Config.FRONTEND_SITE_NAME
 
 # Add this near the top of your app.py, after initializing the app

src/backend/config.py

@@ -37,6 +37,7 @@ class Config:
     COSMOSDB_CONTAINER = GetRequiredConfig("COSMOSDB_CONTAINER")
 
     AZURE_OPENAI_DEPLOYMENT_NAME = GetRequiredConfig("AZURE_OPENAI_DEPLOYMENT_NAME")
+    AZURE_OPENAI_MODEL_NAME = GetOptionalConfig("AZURE_OPENAI_MODEL_NAME", default=AZURE_OPENAI_DEPLOYMENT_NAME)
     AZURE_OPENAI_API_VERSION = GetRequiredConfig("AZURE_OPENAI_API_VERSION")
     AZURE_OPENAI_ENDPOINT = GetRequiredConfig("AZURE_OPENAI_ENDPOINT")
     AZURE_OPENAI_API_KEY = GetOptionalConfig("AZURE_OPENAI_API_KEY")
@@ -89,7 +90,8 @@ def GetAzureOpenAIChatCompletionClient(model_capabilities):
         if Config.AZURE_OPENAI_API_KEY == "":
             # Use DefaultAzureCredential for auth
             Config.__aoai_chatCompletionClient = AzureOpenAIChatCompletionClient(
-                model=Config.AZURE_OPENAI_DEPLOYMENT_NAME,
+                model=Config.AZURE_OPENAI_MODEL_NAME,
+                azure_deployment=Config.AZURE_OPENAI_DEPLOYMENT_NAME,
                 api_version=Config.AZURE_OPENAI_API_VERSION,
                 azure_endpoint=Config.AZURE_OPENAI_ENDPOINT,
                 azure_ad_token_provider=Config.GetTokenProvider(
@@ -101,7 +103,8 @@ def GetAzureOpenAIChatCompletionClient(model_capabilities):
         else:
             # Fallback behavior to use API key
             Config.__aoai_chatCompletionClient = AzureOpenAIChatCompletionClient(
-                model=Config.AZURE_OPENAI_DEPLOYMENT_NAME,
+                model=Config.AZURE_OPENAI_MODEL_NAME,
+                azure_deployment=Config.AZURE_OPENAI_DEPLOYMENT_NAME,
                 api_version=Config.AZURE_OPENAI_API_VERSION,
                 azure_endpoint=Config.AZURE_OPENAI_ENDPOINT,
                 api_key=Config.AZURE_OPENAI_API_KEY,

src/frontend/wwwroot/app.html

@@ -17,7 +17,7 @@
             <aside class="menu mx-3 mt-5">
                 <strong id="goHomeButton" class="menu-logo is-flex is-align-items-center">
                     <img class="mr-3" src="../assets/app-logo.svg">
-                    <span>Multi-Agent: Custom Automation Engine</span>
+                    <span>Multi-Agent-Custom-Automation-Engine</span>
                 </strong>
                 <button id="newTaskButton" class="button is-fullwidth my-6">New task</button>
                 <p class="menu-label">My tasks</p>