refactor(docs): code analysis engine

changes:
  - file: optimized_batch_processor.py
    area: cli
    removed: [create_optimized_batch_processor, __init__, _validate_single_file, _handle_no_files_found, _process_files_sequential, _process_files_parallel, +8 more]
  - file: output_formatters.py
    area: cli
    modified: [output_batch_rich, output_batch_json]
  - file: scoring.py
    area: core
    modified: [ValidationResult]

stats:
  lines: "+1696/-1767 (net -71)"
  files: 23
  complexity: "Large structural change (normalized)"

Author: tom-sapletta-com

CHANGELOG.md

@@ -124,37 +124,27 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 - **Tree-sitter for all** — syntax validation for 165+ languages
 - **Example 07** — comprehensive multi-language demo with 8 languages
 
-## [0.1.11] - 2026-03-23
+## [0.1.12] - 2026-03-23
 
 ### Docs
 - Update CHANGELOG.md
 - Update README.md
-- Update TODO.md
 - Update docs/README.md
 - Update project/README.md
 - Update project/context.md
 
-### Test
-- Update tests/conftest.py
-- Update tests/test_cli_e2e.py
-- Update tests/test_installation.py
-- Update tests/test_performance.py
-- Update tests/test_plugins.py
-- Update tests/test_sandbox.py
-- Update tests/test_semantic_validation.py
-
 ### Other
-- Update .gitignore
-- Update .pre-commit-hooks.yaml
-- Update Makefile
-- Update examples/01_basic_validation/.vallm/basic_validation_summary.json
-- Update examples/01_basic_validation/main.py
-- Update examples/02_ast_comparison/main.py
-- Update examples/03_security_check/main.py
-- Update examples/04_graph_analysis/main.py
-- Update examples/05_llm_semantic_review/main.py
-- Update examples/05_llm_semantic_review/main_template.py
-- ... and 38 more files
+- Update project/analysis.toon
+- Update project/calls.mmd
+- Update project/calls.png
+- Update project/compact_flow.mmd
+- Update project/compact_flow.png
+- Update project/dashboard.html
+- Update project/duplication.toon
+- Update project/evolution.toon
+- Update project/flow.mmd
+- Update project/flow.png
+- ... and 6 more files
 
 ## [0.1.11] - 2026-03-23
 
@@ -195,12 +185,23 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 | Code Duplication | 504 lines | 35 lines | ✅ **93% eliminated** |
 | CLI Module Size | 850 lines | 9 lines | ✅ **99% reduction** |
 
+### 🛠️ New Validators
+- **LogicalErrorValidator** — Tier 1: pyflakes integration for detecting logical errors and unused imports
+- **LintValidator** — Tier 1: ruff integration for style and lint checks with JSON output
+- **SemanticCache** — Caching layer for semantic validation results to improve performance
+
 ### 🛠️ New Shared Utilities
 - `examples/utils/validation_runner.py` - Standard validation patterns
 - `examples/utils/extract_code_from_response.py` - LLM response parsing
 - `examples/12_ollama_simple_demo/utils/` - Demo-specific utilities
 - Enhanced `BaseImportValidator` - Common validation logic
 
+### 🧪 New Test Suites
+- **test_sandbox.py** — Comprehensive sandbox runner tests (8 test cases)
+- **test_plugins.py** — Plugin system tests for pluggy integration (8 test cases)
+- **test_performance.py** — Performance and load testing (12 test cases)
+- Enhanced test coverage in existing test files
+
 ### 📚 Documentation Updates
 - **README.md** - Updated architecture section with new modular structure
 - **TODO.md** - Marked major refactoring tasks as completed

README.md

@@ -136,6 +136,28 @@ vallm check src/main.go
 vallm info
 ```
 
+### Generate Validation Summary File
+
+```bash
+# JSON summary for entire project
+vallm batch . --recursive --format json > validation-summary.json
+
+# YAML summary for src/ directory
+vallm batch src/ --recursive --format yaml > validation-summary.yaml
+
+# TOON format (compact) for CI/CD
+vallm batch . --recursive --format toon > validation-summary.toon
+
+# Text format with security checks
+vallm batch . --recursive --format text --security > validation-report.txt
+
+# Full validation with semantic review - save to file
+vallm batch . --recursive --semantic --model qwen2.5-coder:7b --format json > full-validation.json
+
+# Tee output to both console and file
+vallm batch . --recursive --format json | tee validation-summary.json
+```
+
 ### Batch Command Options
 
 | Option | Short | Description |

VERSION

@@ -1 +1 @@
-0.1.11
+0.1.12

docs/README.md

@@ -1,7 +1,7 @@
 <!-- code2docs:start --># vallm
 
-![version](https://img.shields.io/badge/version-0.1.0-blue) ![python](https://img.shields.io/badge/python-%3E%3D3.10-blue) ![coverage](https://img.shields.io/badge/coverage-unknown-lightgrey) ![functions](https://img.shields.io/badge/functions-329-green)
-> **329** functions | **41** classes | **82** files | CC̄ = 3.6
+![version](https://img.shields.io/badge/version-0.1.0-blue) ![python](https://img.shields.io/badge/python-%3E%3D3.10-blue) ![coverage](https://img.shields.io/badge/coverage-unknown-lightgrey) ![functions](https://img.shields.io/badge/functions-322-green)
+> **322** functions | **40** classes | **82** files | CC̄ = 3.4
 
 > Auto-generated project documentation from source code analysis.
 
@@ -151,7 +151,7 @@ Content outside the markers is preserved when regenerating. Enable this with `sy
 
 ```
 vallm/
-    ├── bump_version        ├── hookspecs    ├── vallm/        ├── __main__        ├── cli/            ├── base            ├── complexity            ├── logical        ├── validators/            ├── semantic_cache            ├── security            ├── syntax            ├── lint            ├── imports/            ├── semantic            ├── graph_diff        ├── core/            ├── ast_compare            ├── proposal            ├── gitignore        ├── scoring            ├── output_formatters            ├── languages            ├── batch_processor            ├── runner        ├── sandbox/                ├── base                ├── javascript_imports                ├── python_imports                ├── go_imports                ├── c_imports                ├── rust_imports                ├── utils                ├── wrapper                ├── factory                ├── java_imports        ├── main_template        ├── main        ├── main        ├── claude_autonomous_demo        ├── main        ├── ollama_simple_demo        ├── iteration_1        ├── best_version        ├── iteration_2        ├── main        ├── main        ├── main        ├── main_template        ├── main        ├── main        ├── refactored_output            ├── optimized_batch_processor    ├── utils/        ├── extraction        ├── save_analysis_data        ├── extract_code_from_response        ├── validation_runner        ├── mcp_demo        ├── logging_utils            ├── order_processor        ├── main            ├── process_user_input            ├── simple_buggy        ├── utils/            ├── load_config            ├── main            ├── calculate_total            ├── save_data├── project    ├── run        ├── run        ├── docker-entrypoint        ├── run        ├── docker-entrypoint        ├── run        ├── docker-entrypoint            ├── data_processor        ├── config            ├── command_handlers```
+├── examples/        ├── cli/        ├── hookspecs    ├── vallm/        ├── __main__    ├── bump_version            ├── base            ├── complexity            ├── logical        ├── validators/            ├── semantic_cache            ├── security            ├── syntax            ├── lint            ├── imports/            ├── semantic            ├── graph_diff        ├── core/            ├── ast_compare            ├── proposal            ├── gitignore        ├── scoring            ├── output_formatters            ├── batch_processor            ├── languages        ├── sandbox/                ├── base                ├── javascript_imports                ├── python_imports                ├── go_imports                ├── c_imports                ├── rust_imports                ├── utils                ├── wrapper                ├── factory                ├── java_imports        ├── main_template        ├── main        ├── main        ├── claude_autonomous_demo        ├── main        ├── ollama_simple_demo        ├── iteration_1        ├── best_version        ├── iteration_2        ├── main        ├── main        ├── main        ├── main_template        ├── main        ├── main        ├── refactored_output            ├── runner    ├── utils/        ├── mcp_demo        ├── extraction        ├── save_analysis_data        ├── extract_code_from_response        ├── logging_utils        ├── validation_runner            ├── order_processor        ├── main            ├── process_user_input            ├── load_config            ├── simple_buggy        ├── utils/            ├── calculate_total            ├── main            ├── save_data├── project    ├── run        ├── run        ├── docker-entrypoint        ├── run        ├── docker-entrypoint        ├── run        ├── docker-entrypoint            ├── data_processor        ├── config            ├── command_handlers```
 
 ## API Overview
 
@@ -174,10 +174,8 @@ vallm/
 - **`Issue`** — A single issue found during validation.
 - **`ValidationResult`** — Result from a single validator.
 - **`PipelineResult`** — Aggregated result from all validators.
-- **`Language`** — Supported programming languages with their tree-sitter identifiers.
 - **`BatchProcessor`** — Handles batch validation of multiple files.
-- **`ExecutionResult`** — Result of sandboxed code execution.
-- **`SandboxRunner`** — Unified interface for running code in a sandbox.
+- **`Language`** — Supported programming languages with their tree-sitter identifiers.
 - **`BaseImportValidator`** — Base class for all import validators.
 - **`JavaScriptImportValidator`** — JavaScript/TypeScript import validator.
 - **`PythonImportValidator`** — Python-specific import validator.
@@ -190,7 +188,8 @@ vallm/
 - **`Colors`** — —
 - **`Colors`** — —
 - **`OrderManager`** — Class with single responsibility - adheres to SOLID principles.
-- **`OptimizedBatchProcessor`** — Optimized batch processor with parallel processing capabilities.
+- **`ExecutionResult`** — Result of sandboxed code execution.
+- **`SandboxRunner`** — Unified interface for running code in a sandbox.
 - **`Colors`** — —
 - **`Colors`** — ANSI color codes for terminal output.
 - **`OrderManager`** — Class with mixed responsibilities - SOLID violation.
@@ -298,16 +297,10 @@ vallm/
 - `save_data(data, filename)` — Save data safely using json.dump.
 - `process_order(data)` — Process order data with proper error handling and validation.
 - `main()` — —
-- `create_optimized_batch_processor(console)` — Create an optimized batch processor instance.
 - `save_analysis_data(example_name, result_data)` — Save analysis data to .vallm folder.
 - `run_validation_examples(example_name, good_code, bad_code, complex_code)` — Run standard validation examples (good, bad, complex code).
 - `validate_code_example(name, code, settings, all_results)` — Validate a code example and store results.
 - `print_summary(all_results)` — Print summary of all validation results.
-- `extract_code_from_response(response, language)` — Extract code from LLM response.
-- `extract_json_from_response(response)` — Extract JSON object from LLM response.
-- `save_analysis_data(example_name, result_data)` — Save analysis data to JSON file.
-- `extract_code_from_response(response)` — Extract Python code from LLM response.
-- `run_validation_examples(example_name, good_code, bad_code, complex_code)` — Run standard validation examples (good, bad, complex code).
 - `log_section(title)` — Print a section header.
 - `log_step(step, description)` — Print a step.
 - `log_code(label, code, max_lines)` — Log code with label.
@@ -317,10 +310,15 @@ vallm/
 - `generate_refactoring_prompt(code, analysis)` — Generate prompt for LLM to refactor code.
 - `run_mcp_workflow(code_path, max_iterations)` — Run the complete MCP workflow.
 - `main()` — Main entry point.
+- `extract_code_from_response(response, language)` — Extract code from LLM response.
+- `extract_json_from_response(response)` — Extract JSON object from LLM response.
+- `save_analysis_data(example_name, result_data)` — Save analysis data to JSON file.
+- `extract_code_from_response(response)` — Extract Python code from LLM response.
 - `log_section(title)` — Print a section header.
 - `log_step(step, description)` — Print a step indicator.
 - `log_code(label, code, max_lines)` — Log code with label and truncation.
 - `log_result(status, message)` — Log a result with appropriate color.
+- `run_validation_examples(example_name, good_code, bad_code, complex_code)` — Run standard validation examples (good, bad, complex code).
 - `process_order(data)` — Process order data - has multiple issues.
 - `load_config()` — Load config - security issue with eval.
 - `save_data(data, filename)` — Save data - uses pickle without validation.
@@ -335,16 +333,16 @@ vallm/
 - `generate_report(code2llm_result, vallm_result, output_path)` — Generate combined analysis report.
 - `main()` — Main example function.
 - `process_user_input(user_input)` — Process user input with standard logic.
+- `load_config()` — Load configuration with default values.
 - `process_user_input(user_input)` — Process user input with security issues.
 - `load_config()` — Load configuration with eval.
 - `save_data(data, filename)` — Save data without validation.
 - `calculate_total(items)` — Calculate total with no error handling.
 - `duplicate_function()` — Another duplicate function.
 - `unused_function()` — This function is never used.
 - `main()` — Main function with problems.
-- `load_config()` — Load configuration with default values.
-- `run_demo_main()` — Run the standard demo main function pattern.
 - `calculate_total(items)` — Calculate total price from items list.
+- `run_demo_main()` — Run the standard demo main function pattern.
 - `save_data(data, filename)` — Save data to JSON file.
 - `run_example()` — —
 - `print_section()` — —
@@ -369,6 +367,7 @@ vallm/
 
 ## Project Structure
 
+📦 `examples`
 📄 `examples.01_basic_validation.main` (1 functions)
 📄 `examples.02_ast_comparison.main` (1 functions)
 📄 `examples.03_security_check.main` (1 functions)
@@ -416,7 +415,6 @@ vallm/
 📦 `src.vallm.cli`
 📄 `src.vallm.cli.batch_processor` (12 functions, 1 classes)
 📄 `src.vallm.cli.command_handlers` (11 functions)
-📄 `src.vallm.cli.optimized_batch_processor` (13 functions, 1 classes)
 📄 `src.vallm.cli.output_formatters` (13 functions)
 📄 `src.vallm.config` (1 functions, 1 classes)
 📦 `src.vallm.core`
@@ -438,8 +436,8 @@ vallm/
 📄 `src.vallm.validators.imports.factory` (3 functions, 1 classes)
 📄 `src.vallm.validators.imports.go_imports` (5 functions, 1 classes)
 📄 `src.vallm.validators.imports.java_imports` (5 functions, 1 classes)
-📄 `src.vallm.validators.imports.javascript_imports` (4 functions, 1 classes)
-📄 `src.vallm.validators.imports.python_imports` (3 functions, 1 classes)
+📄 `src.vallm.validators.imports.javascript_imports` (7 functions, 1 classes)
+📄 `src.vallm.validators.imports.python_imports` (6 functions, 1 classes)
 📄 `src.vallm.validators.imports.rust_imports` (5 functions, 1 classes)
 📄 `src.vallm.validators.imports.utils` (2 functions)
 📄 `src.vallm.validators.imports.wrapper` (1 functions, 1 classes)

project/README.md

@@ -10,7 +10,7 @@ When you run `code2llm ./ -f all`, the following files are created:
 
 | File | Format | Purpose | Key Insights |
 |------|--------|---------|--------------|
-| `analysis.toon` | **TOON** | **🔥 Health diagnostics** - Complexity, god modules, coupling | 6 critical functions, 0 god modules |
+| `analysis.toon` | **TOON** | **🔥 Health diagnostics** - Complexity, god modules, coupling | 9 critical functions, 0 god modules |
 | `evolution.toon` | **TOON** | **📋 Refactoring queue** - Prioritized improvements | 0 refactoring actions needed |
 | `flow.toon` | **TOON** | **🔄 Data flow analysis** - Pipelines, contracts, types | Data dependencies and side effects |
 | `map.toon` | **TOON** | **🗺️ Structural map** - Modules, imports, signatures | Project architecture overview |
@@ -338,8 +338,8 @@ code2llm ./ -f yaml --separate-orphans
 
 **Generated by**: `code2llm ./ -f all --readme`  
 **Analysis Date**: 2026-03-23  
-**Total Functions**: 12041  
-**Total Classes**: 3032  
-**Modules**: 1414  
+**Total Functions**: 12079  
+**Total Classes**: 3036  
+**Modules**: 1419  
 
 For more information about code2llm, visit: https://github.com/tom-sapletta/code2llm