Skip to content

franciscovfonseca/AI-System-Inventory

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

15 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

AI System Inventory & Classification Engine

πŸ€– AI System Inventory & Classification Engine

EU AI Act NIST AI RMF ISO 42001 Python License: MIT Status

Phase 1 of an end-to-end AI Governance Programme


πŸ“Œ Project Overview

NorthPoint Financial Services - a mid-size financial institution operating in the EU - had no centralised visibility into its AI systems. Leadership could not answer the most fundamental governance question: "What AI are we running, how risky is it and are we compliant?"

This project delivered that answer. I designed and executed a complete AI system inventory programme covering four production AI systems across credit, fraud, customer support and marketing. The output: a structured inventory, EU AI Act risk classification with full legal reasoning, NIST AI RMF control mapping, automated governance validation and an executive report ready for board and regulatory review.

The business impact: NorthPoint can now demonstrate to regulators, auditors and the board exactly which AI systems it operates, what risk tier each carries, what obligations apply and what controls are in place - with documented, auditable evidence for every decision.

This project is Phase 1 of an ongoing AI governance programme. Phase 2 applies deep risk assessment methodology to the two HIGH RISK systems identified here. β†’ View Phase 2


🎯 What I Delivered

Deliverable Description
AI System Inventory Structured CSV + JSON capturing all AI systems, owners, data sources and review cycles
EU AI Act Classification Risk-tiered classification for each system with full legal reasoning and regulatory obligations
NIST AI RMF Mapping Control mapping across all four RMF functions per system, proportionate to risk level
ISO 42001 Alignment High-level alignment check against ISO 42001 AI Management System requirements
Automated Validator Python script that checks inventory completeness and flags governance gaps before reporting
Executive Governance Report Board-ready report generated directly from validated inventory data

πŸ—Ί Architecture & Data Flow

flowchart TD
    A[🏒 NorthPoint Financial Services\n4 Production AI Systems] --> B[πŸ“‹ AI System Inventory\nCSV + JSON]

    B --> C{EU AI Act\nRisk Classifier}
    B --> G[NIST AI RMF\nControl Mapper]

    C -->|2 Systems| D[πŸ”΄ HIGH RISK\nArticles 9–15 Obligations]
    C -->|1 System| E[🟑 LIMITED RISK\nArticle 50 Transparency]
    C -->|1 System| F[🟒 MINIMAL RISK\nVoluntary Codes Only]

    G --> H[πŸ”΅ GOVERN]
    G --> I[🟣 MAP]
    G --> J[🟠 MEASURE]
    G --> K[🟀 MANAGE]

    D & E & F --> L[βœ… Inventory Validator\n12 Governance Checks]
    H & I & J & K --> L

    L --> M[πŸ“„ Executive Governance Report]
    M --> N[πŸ‘” Board & Regulatory Review]

    style D fill:#ff4444,color:#fff
    style E fill:#ffaa00,color:#fff
    style F fill:#00aa44,color:#fff
Loading

πŸ” AI Systems Inventoried

ID System Purpose Sector Automated Decision
NP-001 Credit Scoring Engine Assesses creditworthiness and determines loan eligibility Financial Services βœ… Yes
NP-002 Fraud Detection System Real-time transaction fraud detection with automatic holds Financial Services βœ… Yes
NP-003 Customer Support Chatbot Tier-1 customer query handling via LLM-powered chat General Purpose ❌ No
NP-004 Marketing Personalisation AI Customer segmentation and campaign personalisation Marketing ❌ No

βš–οΈ EU AI Act Risk Classification

I applied the EU AI Act's four-tier risk model to each system, with documented reasoning for every classification decision.

pie title EU AI Act Risk Distribution - NorthPoint Financial Services
    "HIGH RISK (Annex III)" : 2
    "LIMITED RISK (Article 50)" : 1
    "MINIMAL RISK" : 1
Loading
System Risk Tier Regulatory Basis Key Obligations
πŸ”΄ Credit Scoring Engine HIGH RISK Annex III Β§5(b) - creditworthiness assessment Articles 9–15: risk management system, data governance, human oversight, transparency, logging
πŸ”΄ Fraud Detection System HIGH RISK Annex III Β§5(b) - financial services Articles 9–15: post-market monitoring, robustness testing, incident reporting
🟑 Customer Support Chatbot LIMITED RISK Article 50(1) - conversational AI Mandatory disclosure: users must know they are interacting with AI
🟒 Marketing Personalisation AI MINIMAL RISK No Annex III classification No mandatory obligations; voluntary codes of conduct encouraged

Classification insight: NP-001 and NP-002 are classified HIGH RISK not because of poor design, but because of where they operate (financial services) and what they decide (access to credit and funds). Under the EU AI Act, context determines classification - not quality.

β†’ Full classification reasoning: docs/eu_ai_act_classification.md


πŸ›‘ NIST AI RMF Control Mapping

Controls were applied proportionate to each system's risk tier across all four NIST AI RMF functions.

quadrantChart
    title NIST AI RMF - Control Coverage vs Risk Level
    x-axis Low Risk --> High Risk
    y-axis Minimal Controls --> Full Governance Suite
    quadrant-1 Full Governance
    quadrant-2 Over-governed
    quadrant-3 Under-governed
    quadrant-4 Proportionate Baseline
    Credit Scoring Engine: [0.85, 0.90]
    Fraud Detection System: [0.80, 0.88]
    Customer Support Chatbot: [0.35, 0.45]
    Marketing Personalisation AI: [0.15, 0.25]
Loading
System GOVERN MAP MEASURE MANAGE Total Controls
πŸ”΄ Credit Scoring Engine 5 5 5 5 20
πŸ”΄ Fraud Detection System 5 5 5 5 20
🟑 Customer Support Chatbot 4 4 2 3 13
🟒 Marketing Personalisation AI 4 4 2 3 13

The HIGH RISK systems received the full 20-control governance suite. The proportionality principle was applied deliberately - applying full controls to low-risk systems creates compliance overhead without reducing actual risk.

β†’ Full control mapping: docs/nist_rmf_mapping.md


βœ… Automated Governance Validation

The inventory is validated by a Python engine that runs 12 checks across every system before any report is generated:

[βœ“] No duplicate system IDs detected
[βœ“] All system IDs match expected format (NP-###)
[βœ“] [NP-001] All mandatory fields populated
[βœ“] [NP-001] HIGH RISK system has a named owner: 'Head of Credit Risk'
[βœ“] [NP-001] HIGH RISK system review cycle within limit (6 months)
[βœ“] [NP-001] Human oversight documented for automated decision system
[βœ“] [NP-002] All mandatory fields populated
[βœ“] [NP-002] HIGH RISK system has a named owner: 'Head of Financial Crime'
[βœ“] [NP-002] HIGH RISK system review cycle within limit (3 months)
[βœ“] [NP-002] Human oversight documented for automated decision system
[βœ“] [NP-003] All mandatory fields populated
[βœ“] [NP-004] All mandatory fields populated

βœ… Validation PASSED - All 12 checks completed successfully.

If any check fails, the script identifies the exact system and field so issues can be corrected before the report goes to leadership.


πŸ“Š Executive Governance Report

The final output is a board-ready governance report generated automatically from validated inventory data - no manual formatting.

Key findings from the NorthPoint Financial Services assessment:

  • 2 of 4 systems (50%) carry HIGH RISK classification under EU AI Act Annex III
  • Full Article 9–15 obligations apply to the Credit Scoring and Fraud Detection systems immediately
  • 26 governance controls are active across the portfolio; HIGH RISK systems carry 20 each
  • Recommended priority action: Conduct formal conformity assessment for NP-001 before next regulatory cycle

β†’ Full report: docs/governance_report.md


πŸ”— Phase 2: AI Risk Assessment

This inventory established what NorthPoint is running and what tier each system falls into.

Phase 2 goes deeper: a full risk assessment on the two HIGH RISK systems - likelihood/impact analysis, bias and fairness evaluation, EU AI Act Article 9 compliance review and a board-level governance memo.

β†’ Phase 2: AI Risk Assessment - NorthPoint Financial Services


πŸ“ Repository Structure

AI-System-Inventory/
β”œβ”€β”€ README.md                          ← You are here
β”œβ”€β”€ banner.png                         ← Project banner
β”œβ”€β”€ configs/
β”‚   β”œβ”€β”€ ai_inventory.csv               ← Structured inventory (spreadsheet-friendly)
β”‚   └── ai_inventory.json              ← Structured inventory (machine-readable)
β”œβ”€β”€ docs/
β”‚   β”œβ”€β”€ eu_ai_act_classification.md    ← Full EU AI Act classification analysis
β”‚   β”œβ”€β”€ nist_rmf_mapping.md            ← Full NIST AI RMF control mapping
β”‚   └── governance_report.md           ← Executive governance report
β”œβ”€β”€ scripts/
β”‚   β”œβ”€β”€ classify_systems.py            ← EU AI Act risk classifier
β”‚   β”œβ”€β”€ map_to_rmf.py                  ← NIST AI RMF mapper
β”‚   β”œβ”€β”€ validate_inventory.py          ← Governance gap validator
β”‚   └── generate_report.py             ← Automated report generator
└── screenshots/
    └── README.md                      ← Screenshot guide

🧠 Skills Demonstrated

Skill Area What This Project Shows
AI Governance End-to-end operationalisation of an AI governance programme from inventory through to board reporting
EU AI Act Compliance Risk-tier classification with documented legal reasoning; Annex III mapping; Article 9–15 obligation identification
NIST AI RMF Proportionate control design across GOVERN / MAP / MEASURE / MANAGE functions
ISO 42001 AI Management System alignment assessment for enterprise AI governance
AI GRC Governance, Risk and Compliance framework design for regulated AI environments
Responsible AI Human oversight design; fairness and transparency obligation mapping
Python Automation Governance validation pipelines; automated executive report generation
Executive Communication Board-ready reporting; translating regulatory obligations into business language

πŸ“š Frameworks & References

Framework Resource
EU AI Act (Official Text) EUR-Lex 2024/1689
EU AI Act Annex III - High-Risk Systems EUR-Lex Annex III
NIST AI Risk Management Framework 1.0 airmf.nist.gov
NIST AI RMF Playbook airc.nist.gov
ISO/IEC 42001:2023 - AI Management Systems iso.org/standard/81230

franciscovfonseca Β· GitHub Β· LinkedIn

MIT License

Part of an ongoing AI Security and AI Governance Portfolio Β· View all projects β†’

About

AI governance artifact that maps, classifies and controls AI systems - aligned to the EU AI Act and NIST AI RMF

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages