Skip to content

Add Azure Monitor workbooks for EDI transaction metrics, payer health, and HIPAA compliance monitoring#80

Merged
aurelianware merged 3 commits intomainfrom
copilot/deploy-azure-monitor-dashboards
Nov 23, 2025
Merged

Add Azure Monitor workbooks for EDI transaction metrics, payer health, and HIPAA compliance monitoring#80
aurelianware merged 3 commits intomainfrom
copilot/deploy-azure-monitor-dashboards

Conversation

Copy link
Contributor

Copilot AI commented Nov 23, 2025

Implements real-time observability for HIPAA X12 EDI transaction processing with automatic PHI redaction and multi-tenant support.

Workbooks

Three production-ready dashboards deployed via Bicep:

EDI Transaction Metrics - Aggregate transaction monitoring

  • Volume, latency (P50/P95/P99), success rates per transaction type (275, 277, 278)
  • Error distribution and dependency health (SFTP, Service Bus, Storage, QNXT)
  • Per-payer breakdown with dynamic filtering

Payer Integration Health - Per-tenant SLA tracking

  • Automated health scoring (0-100%) from success rate, latency, volume, freshness
  • Backend integration status with traffic light indicators
  • Transaction trends and error analysis per payer

HIPAA Compliance Monitoring - Security validation

  • PHI pattern detection (SSN/Member ID/DOB references in logs)
  • HTTPS enforcement validation
  • Security audit events and authentication metrics
  • Data retention compliance tracking

All queries exclude PHI fields and use aggregate-only metrics.

Infrastructure

  • infra/modules/workbooks.bicep - Deploys workbooks with Application Insights integration
  • infra/main.bicep - Added workbook module and direct portal URL outputs

Alerting

ARM template deploys 6 alert rules:

  • Low success rate (<95%), high latency (P95 >5s)
  • Critical: PHI exposure detection, unencrypted HTTP traffic
  • Payer integration failures, dependency health

Example KQL for PHI exposure alert:

traces
| where timestamp > ago(5m)
| where message matches regex @"\b\d{3}-\d{2}-\d{4}\b"  // SSN pattern
    or message matches regex @"\b[A-Z]{2}\d{9}\b"       // Member ID
    or message matches regex @"DOB|SSN|Patient\s*Name"
| count

Documentation

  • docs/AZURE-MONITOR-DASHBOARDS.md - Dashboard guide, KQL queries, PHI redaction config, troubleshooting
  • docs/examples/azure-monitor-alerts-config.json - ARM template for alert deployment
  • docs/examples/ALERTING-SETUP-GUIDE.md - Step-by-step alert configuration
  • Updated ONBOARDING.md and ARCHITECTURE.md with monitoring sections

Deployment

Workbooks deploy automatically with infrastructure:

az deployment group create \
  --template-file infra/main.bicep \
  --parameters baseName=<name> ...

Alert rules deploy separately:

az deployment group create \
  --template-file docs/examples/azure-monitor-alerts-config.json \
  --parameters appInsightsId="<id>" actionGroupId="<id>"
Original prompt

This section details on the original issue you should resolve

<issue_title>Deploy Azure Monitor Dashboards</issue_title>
<issue_description>Build real-time metrics dashboard using Azure Monitor workbooks. Track transaction latency, error rates, and volume per payer integration. Parameterize for multi-tenant deployments, integrate Application Insights, and ensure PHI redaction in logs and telemetry. Document dashboard setup and alerting rules.</issue_description>

Comments on the Issue (you are @copilot in this section)


💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

Copilot AI changed the title [WIP] Deploy Azure Monitor dashboards for metrics tracking Add Azure Monitor workbooks for EDI transaction metrics, payer health, and HIPAA compliance monitoring Nov 23, 2025
Copilot AI requested a review from aurelianware November 23, 2025 20:22
@aurelianware aurelianware requested review from Copilot and removed request for aurelianware November 23, 2025 20:27
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR implements comprehensive Azure Monitor observability for the Cloud Health Office EDI transaction processing system. It delivers three production-ready workbooks with automatic PHI redaction, multi-tenant support, detailed alerting configuration, and extensive documentation.

Key Changes

  • Added three Azure Monitor Workbooks (EDI Transaction Metrics, Payer Integration Health, HIPAA Compliance Monitoring)
  • Created Bicep infrastructure module for automated workbook deployment
  • Provided ARM template with 6 production-ready alert rules
  • Delivered comprehensive documentation including setup guides and troubleshooting

Reviewed changes

Copilot reviewed 12 out of 12 changed files in this pull request and generated no comments.

Show a summary per file
File Description
infra/modules/workbooks/edi-transaction-metrics.json Workbook template for transaction volume, latency (P50/P95/P99), success rates, and error patterns across all payers
infra/modules/workbooks/payer-integration-health.json Per-payer health monitoring with 0-100% scoring based on success rate, latency, volume, and freshness
infra/modules/workbooks/hipaa-compliance-monitoring.json PHI pattern detection, encryption validation, security audit events, and compliance scoring
infra/modules/workbooks.bicep Bicep module that deploys all three workbooks with Application Insights integration and portal URLs
infra/main.bicep Integration of workbooks module into main infrastructure with outputs for workbook IDs and URLs
infra/main.json Compiled ARM template with embedded workbook module (includes future API version issues)
docs/examples/azure-monitor-alerts-config.json ARM template deploying 6 alert rules for success rate, latency, PHI exposure, encryption, and dependency monitoring
docs/examples/ALERTING-SETUP-GUIDE.md Step-by-step guide for Action Group creation, alert deployment, customization, and troubleshooting
docs/AZURE-MONITOR-DASHBOARDS.md Comprehensive documentation of all dashboards, KQL queries, alerting rules, PHI redaction, and best practices
docs/MONITORING-IMPLEMENTATION-SUMMARY.md Implementation summary with deliverables overview, features, usage examples, and deployment instructions
ONBOARDING.md Added monitoring section with dashboard access instructions and alert setup commands
ARCHITECTURE.md Enhanced Application Insights section with dashboard descriptions and alerting rules summary

@aurelianware
Copy link
Owner

@copilot the code coverage checks are failing please resolve checks and make them compatible with other recent features committed to main branch

Copilot AI and others added 3 commits November 23, 2025 15:56
…, and HIPAA compliance monitoring

Co-authored-by: aurelianware <194855645+aurelianware@users.noreply.github.com>
…nitoring references

Co-authored-by: aurelianware <194855645+aurelianware@users.noreply.github.com>
Co-authored-by: aurelianware <194855645+aurelianware@users.noreply.github.com>
@aurelianware aurelianware force-pushed the copilot/deploy-azure-monitor-dashboards branch from c21c9ba to 2aefbef Compare November 23, 2025 22:56
@aurelianware aurelianware marked this pull request as ready for review November 23, 2025 23:00
@aurelianware aurelianware requested a review from Copilot November 23, 2025 23:02
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 12 out of 12 changed files in this pull request and generated no new comments.

@aurelianware aurelianware merged commit 4b81c34 into main Nov 23, 2025
8 of 11 checks passed
@aurelianware aurelianware deleted the copilot/deploy-azure-monitor-dashboards branch November 23, 2025 23:04
Copilot AI requested a review from aurelianware November 23, 2025 23:04
aurelianware added a commit that referenced this pull request Mar 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Deploy Azure Monitor Dashboards

3 participants