Sushama/eng 1135 ai master engineer production readiness audit and completion

.env.patentsberta.example

@@ -0,0 +1,43 @@
+# PatentsBERTa Embedding Configuration Example
+# Copy this file to .env and update with your values
+
+# Enable PatentsBERTa embeddings
+OPENAI_HOST=patentsberta
+
+# PatentsBERTa service configuration
+PATENTSBERTA_ENDPOINT=https://patentsberta-embeddings.YOUR_REGION.azurecontainerapps.io
+PATENTSBERTA_API_KEY=your-secure-api-key-here  # Required for API authentication
+
+# Embedding configuration for PatentsBERTa (768 dimensions)
+AZURE_OPENAI_EMB_DIMENSIONS=768
+AZURE_OPENAI_EMB_MODEL_NAME=PatentSBERTa
+
+# Search index configuration
+AZURE_SEARCH_FIELD_NAME_EMBEDDING=embedding_patentsberta
+
+# Keep existing Azure configuration
+AZURE_SUBSCRIPTION_ID=your-subscription-id
+AZURE_RESOURCE_GROUP=rg-ai-master-engineer
+AZURE_LOCATION=eastus
+
+# Azure Search Service
+AZURE_SEARCH_SERVICE=your-search-service
+AZURE_SEARCH_INDEX=your-search-index
+AZURE_SEARCH_KEY=your-search-key
+
+# Azure Storage
+AZURE_STORAGE_ACCOUNT=your-storage-account
+AZURE_STORAGE_CONTAINER=content
+AZURE_STORAGE_KEY=your-storage-key
+
+# Azure OpenAI (still needed for chat completions)
+AZURE_OPENAI_SERVICE=your-openai-service
+AZURE_OPENAI_CHATGPT_DEPLOYMENT=your-chat-deployment
+AZURE_OPENAI_CHATGPT_MODEL=gpt-4
+AZURE_OPENAI_API_VERSION=2024-06-01
+
+# Optional: Document Intelligence for advanced parsing
+AZURE_DOCUMENTINTELLIGENCE_SERVICE=your-doc-intelligence-service
+
+# Optional: Vision services for multimodal
+AZURE_VISION_ENDPOINT=https://your-vision-service.cognitiveservices.azure.com/

.gitignore

@@ -109,8 +109,13 @@ celerybeat.pid
 # SageMath parsed files
 *.sage.py
 
-# Environments
+# Environments and secrets
 .env
+.env.*
+*.env
+*.key
+*.secret
+*.pem
 .venv
 .evalenv
 env/
@@ -119,6 +124,14 @@ ENV/
 env.bak/
 venv.bak/
 
+# API keys and credentials
+*_key
+*_secret
+*_token
+credentials.json
+secrets.json
+agents/verify_credentials.py
+
 # Spyder project settings
 .spyderproject
 .spyproject
@@ -149,5 +162,37 @@ node_modules
 static/
 
 data/**/*.md5
-
+/data/*
+!/data/.gitkeep
+!/data/README.md
+
+# Large files and data
+*.pdf
+!tests/test-data/*.pdf
+*.zip
+*.tar.gz
+*.7z
+*.rar
+
+# Cache and temporary files
+.cache/
+*.cache
+*.tmp
+*.temp
+*.swp
+*.swo
+*~
+
+# OS files
 .DS_Store
+Thumbs.db
+desktop.ini
+
+# IDE files
+.vscode/
+.idea/
+*.sublime-*
+
+tests/test_application.py
+tests/test_ollama_ocr.py
+tests/test_response_accuracy.py

agents/.deployment

@@ -0,0 +1,7 @@
+[config]
+SCM_DO_BUILD_DURING_DEPLOYMENT=true
+
+
+
+
+

agents/README.md

@@ -0,0 +1,187 @@
+# Microsoft 365 RAG Agent
+
+This directory contains the Microsoft 365 Agents SDK client that replaces the web frontend. The agent provides AI-powered document search and chat capabilities across Microsoft 365 channels including Teams, Copilot, and web chat by calling the existing backend API.
+
+## Architecture
+
+```
+┌─────────────────────────────────────────────────────────────┐
+│                    Microsoft 365 Channels                   │
+│  ┌─────────────┐  ┌─────────────┐  ┌─────────────┐        │
+│  │    Teams    │  │   Copilot   │  │  Web Chat   │        │
+│  └─────────────┘  └─────────────┘  └─────────────┘        │
+└─────────────────────────────────────────────────────────────┘
+                            │
+                            ▼
+┌─────────────────────────────────────────────────────────────┐
+│              Microsoft 365 Agents SDK                      │
+│  ┌─────────────────────────────────────────────────────┐   │
+│  │              Agent Application                      │   │
+│  │  • Message Handlers                                │   │
+│  │  • Channel Adapters                                │   │
+│  │  • Response Formatting                             │   │
+│  └─────────────────────────────────────────────────────┘   │
+└─────────────────────────────────────────────────────────────┘
+                            │
+                            ▼
+┌─────────────────────────────────────────────────────────────┐
+│                    Existing Backend                        │
+│  ┌─────────────────────────────────────────────────────┐   │
+│  │              Quart API Server                       │   │
+│  │  • /chat endpoint                                  │   │
+│  │  • /ask endpoint                                   │   │
+│  │  • RAG Approaches                                  │   │
+│  │  • Azure Services                                  │   │
+│  └─────────────────────────────────────────────────────┘   │
+└─────────────────────────────────────────────────────────────┘
+```
+
+## Project Structure
+
+```
+agents/
+├── main.py                 # Main entry point
+├── agent_app.py           # Core agent application
+├── config/
+│   └── agent_config.py    # Configuration management
+├── services/
+│   ├── rag_service.py     # Backend API client
+│   └── auth_service.py    # Authentication service
+├── handlers/
+│   ├── message_handler.py # General message handler
+│   └── teams_handler.py   # Teams-specific handler
+├── adapters/
+│   └── response_adapter.py # Channel-specific response formatting
+└── requirements.txt       # Python dependencies
+```
+
+## Features
+
+- **Multi-Channel Support**: Works with Teams, Copilot, and web chat
+- **Backend Integration**: Calls existing RAG backend API
+- **Authentication**: Microsoft 365 authentication and authorization
+- **Rich Responses**: Adaptive cards, citations, and interactive elements
+- **Conversation State**: Maintains context across conversations
+- **Error Handling**: Robust error handling and logging
+- **No Duplication**: Reuses existing backend logic and services
+
+## Setup
+
+### 1. Install Dependencies
+
+```bash
+cd agents
+pip install -r requirements.txt
+```
+
+### 2. Configure Environment
+
+```bash
+cp .env.example .env
+# Edit .env with your configuration values
+```
+
+### 3. Required Configuration
+
+- **Bot Framework**: App ID and password from Azure Bot Service
+- **Microsoft 365**: Tenant ID, client ID, and client secret
+- **Backend API**: URL of the existing RAG backend (e.g., http://localhost:50505)
+
+### 4. Run the Agent
+
+```bash
+python main.py
+```
+
+## Configuration
+
+### Environment Variables
+
+| Variable | Description | Required |
+|----------|-------------|----------|
+| `MICROSOFT_APP_ID` | Bot Framework app ID | Yes |
+| `MICROSOFT_APP_PASSWORD` | Bot Framework app password | Yes |
+| `AZURE_TENANT_ID` | Microsoft 365 tenant ID | Yes |
+| `AZURE_CLIENT_ID` | Microsoft 365 client ID | Yes |
+| `AZURE_CLIENT_SECRET` | Microsoft 365 client secret | Yes |
+| `BACKEND_URL` | URL of the existing RAG backend | Yes |
+
+### Agent Settings
+
+| Variable | Description | Default |
+|----------|-------------|---------|
+| `AGENT_NAME` | Display name for the agent | "RAG Assistant" |
+| `AGENT_DESCRIPTION` | Agent description | "AI-powered document search and chat assistant" |
+| `MAX_CONVERSATION_TURNS` | Maximum conversation turns | 20 |
+| `ENABLE_TYPING_INDICATOR` | Enable typing indicators | true |
+| `ENABLE_TEAMS` | Enable Teams channel | true |
+| `ENABLE_COPILOT` | Enable Copilot channel | true |
+| `ENABLE_WEB_CHAT` | Enable web chat channel | true |
+
+## API Endpoints
+
+### Health Check
+- **GET** `/` - Basic health check
+- **GET** `/api/health` - Detailed health check
+
+### Bot Framework
+- **POST** `/api/messages` - Main Bot Framework endpoint
+
+### Configuration
+- **GET** `/api/config` - Get agent configuration (non-sensitive)
+
+## Development
+
+### Running Locally
+
+1. Set up your environment variables
+2. Run the agent: `python main.py`
+3. Use Bot Framework Emulator to test locally
+
+### Testing with Teams
+
+1. Deploy to Azure
+2. Register with Azure Bot Service
+3. Configure Teams channel
+4. Test in Teams
+
+## Integration with Backend
+
+The agent integrates with the existing RAG backend by:
+
+1. **API Calls**: Calls existing `/chat` and `/chat/stream` endpoints
+2. **No Duplication**: Reuses all existing RAG logic and services
+3. **Authentication**: Passes through user context to backend
+4. **Response Formatting**: Adapts backend responses for Microsoft 365 channels
+
+## Next Steps
+
+1. **Phase 2**: Test backend integration and response formatting
+2. **Phase 3**: Add Teams-specific features (adaptive cards, file handling)
+3. **Phase 4**: Implement Copilot integration
+4. **Phase 5**: Add advanced features and monitoring
+
+## Troubleshooting
+
+### Common Issues
+
+1. **Authentication Errors**: Check Microsoft 365 app registration
+2. **Bot Framework Errors**: Verify app ID and password
+3. **Azure Service Errors**: Check service endpoints and keys
+4. **Channel Errors**: Verify channel configuration
+
+### Logs
+
+The agent logs to stdout with structured logging. Check logs for:
+- Authentication issues
+- Service connection problems
+- Message processing errors
+- Channel-specific issues
+
+## Support
+
+For issues and questions:
+1. Check the logs for error details
+2. Verify configuration values
+3. Test with Bot Framework Emulator
+4. Check Azure service status

agents/adapters/__init__.py

@@ -0,0 +1,6 @@
+# Adapters package
+
+
+
+
+