Skip to content

This demonstration showcases the complete setup of the infrastructure required to build a generative AI agent using Azure AI Foundry and Azure OpenAI Service. This example is configured within a public network; however, please ensure you adapt the implementation to align with your specific use case and best practices of security, etc.

License

Notifications You must be signed in to change notification settings

MicrosoftCloudEssentials-LearningHub/AI-Agent-Infra-Blueprint

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

69 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Azure AI Agent:
Infrastructure Blueprint - Deployment Guide

Costa Rica

GitHub GitHub brown9804

Last updated: 2025-07-17


Tip

Please clone/download this repository to use this configuration as a blueprint.

Important

This example is based on a public network site and is intended for demonstration purposes only. It showcases how several Azure resources can work together to achieve the desired result. Consider the section below about Important Considerations for Production Environment.

List of References (Click to expand)
Table of Content (Click to expand)

Overview

Below are the resources set up in Azure via Terraform. Please follow this guide to deploy the listed resources:

Centered Image
  1. Azure AI Foundry Hub and Project
  2. Azure AI Foundry connections (using key or Entra authentication)
    • Azure Open AI service
    • Azure AI search service
  3. Azure Infrastructure Components:
    • Azure Key Vault: Securely store and manage secrets, keys, and certificates.
    • Azure Storage Account: Provides a scalable storage solution for AI-related data.
    • Resource Group: Centralized management for deployed Azure resources.
  4. Permissions assigned in Azure AI Foundry:
    • Azure AI Developer permission for AI project/resource group level.
    • Cognitive Services OpenAI User permission at resource group level.
  5. Post-Provisioning Steps:
    • Deploy GPT-4o-mini (or any GPT model of your choice) 🡢 AFTER provisioning Azure Open AI.
    • Deploy text-embedding-ada-002 🡢 AFTER provisioning Azure Open AI using the appropriate model deployment approach.
    • Create Azure AI Search Index 🡢 AFTER provisioning Azure AI Search.

Important Considerations for Production Environment

Public Network Site

This example is based on a public network site and is intended for demonstration purposes only. It showcases how several Azure resources can work together to achieve the desired result.

Private Network Configuration

For enhanced security, consider configuring your Azure resources to operate within a private network. This can be achieved using Azure Virtual Network (VNet) to isolate your resources and control inbound and outbound traffic. Implementing private endpoints for services like Azure Blob Storage and Azure Functions can further secure your data by restricting access to your VNet.

Security

Ensure that you implement appropriate security measures when deploying this solution in a production environment. This includes:

  • Securing Access: Use Azure Entra ID (formerly known as Azure Active Directory or Azure AD) for authentication and role-based access control (RBAC) to manage permissions.
  • Managing Secrets: Store sensitive information such as connection strings and API keys in Azure Key Vault.
  • Data Encryption: Enable encryption for data at rest and in transit to protect sensitive information.
Scalability

While this example provides a basic setup, you may need to scale the resources based on your specific requirements. Azure services offer various scaling options to handle increased workloads. Consider using:

  • Auto-scaling: Configure auto-scaling for Azure Functions and other services to automatically adjust based on demand.
  • Load Balancing: Use Azure Load Balancer or Application Gateway to distribute traffic and ensure high availability.
Cost Management

Monitor and manage the costs associated with your Azure resources. Use Azure Cost Management and Billing to track usage and optimize resource allocation.

Compliance

Ensure that your deployment complies with relevant regulations and standards. Use Azure Policy to enforce compliance and governance policies across your resources.

Disaster Recovery

Implement a disaster recovery plan to ensure business continuity in case of failures. Use Azure Site Recovery and backup solutions to protect your data and applications.

Note

Please note that these demos are intended as a guide and are based on my personal experiences. For official guidance, support, or more detailed information, please refer to Microsoft's official documentation or contact Microsoft directly: Microsoft Sales and Support

Total views

Refresh Date: 2025-07-17

About

This demonstration showcases the complete setup of the infrastructure required to build a generative AI agent using Azure AI Foundry and Azure OpenAI Service. This example is configured within a public network; however, please ensure you adapt the implementation to align with your specific use case and best practices of security, etc.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •  

Languages