Security Updates + Deployment Scripts + Kubernetes Deployment Setup

[ritankarsaha]

📌 Description

Security Implementation

• API Security Packages: Added helmet, express-rate-limit, cors, and
  sentry packages
• Security Middleware: Created production-grade security
  configurations with proper headers, rate limiting, and CORS
• Environment Separation: Proper dev/prod configurations with
  environment variables

Logging & Monitoring

• Winston Logging: Comprehensive structured logging system with file
  rotation
• HTTP Middleware: Request/response logging with performance tracking
• Error Tracking: Sentry integration for client and server-side error
  monitoring
• Metrics Collection: Prometheus-compatible metrics endpoint

Deployment Solutions

• EC2 Deployment: Production-ready PM2 script with Nginx, SSL, and
  monitoring
• Kubernetes: Complete manifests with HPA, resource limits, and
  security contexts
• Comprehensive Documentation: Detailed deployment guide in
  DEPLOYMENT.md

Enhanced API Integration

• AI Service Logging: Comprehensive logging for Anthropic API calls
  with token tracking
• GitHub API Logging: External API monitoring with rate limit tracking
• Airtable Integration: Request/response logging with proper error
  handling
• Health & Metrics Endpoints: Production monitoring endpoints

Checklist

• I have tested this code
• I have added necessary documentation
• I have linked relevant issue(s)
• I followed the code style of the project
• I reviewed my own code

[Copilot]

Pull Request Overview

This PR implements comprehensive security enhancements, monitoring infrastructure, and production deployment capabilities for the PLDG Dashboard. The changes establish enterprise-grade security with proper authentication, logging, and observability systems.

Key Changes:

• Security Implementation: Added security middleware with rate limiting, CORS protection, and comprehensive security headers
• Monitoring & Logging: Implemented Winston-based structured logging with Prometheus metrics collection and Sentry error tracking
• Production Deployment: Created deployment scripts for EC2 and complete Kubernetes manifests with HPA and security contexts

Reviewed Changes

Copilot reviewed 21 out of 25 changed files in this pull request and generated 9 comments.

Show a summary per file

File	Description
src/lib/security.ts	Core security middleware with rate limiting, CORS validation, and security headers
src/lib/monitoring.ts	Metrics collection system with Prometheus integration
src/lib/middleware.ts	HTTP request middleware with comprehensive logging and error handling
src/lib/logger.ts	Winston-based structured logging system with specialized logging methods
src/app/api/*/route.ts	Updated API routes with logging integration and middleware wrapping
scripts/deploy-ec2.sh	Production-ready EC2 deployment script with PM2, Nginx, and SSL
k8s/*.yaml	Complete Kubernetes deployment manifests with security and scaling configurations
sentry.*.config.ts	Client and server-side error tracking configuration
middleware.ts	Global Next.js middleware for security and request tracking