Skip to content

Feature/UI Restructure autogeneration scripts: Move to src_py/autogen directory#423

Merged
leondavi merged 14 commits intomasterfrom
feature/ui
Dec 31, 2025
Merged

Feature/UI Restructure autogeneration scripts: Move to src_py/autogen directory#423
leondavi merged 14 commits intomasterfrom
feature/ui

Conversation

@leondavi
Copy link
Copy Markdown
Owner

@leondavi leondavi commented Oct 9, 2025

No description provided.

- Moved autogeneration scripts from src_py/nerlPlanner/ to src_py/autogen/
- Updated NerlnetBuild.sh to use new autogen directory paths
- Changed generated comments from 'Generated by Nerlplanner' to 'Generated by autogen'
- Organized all auto-generation functionality in dedicated autogen library
- Added README.md documentation for the autogen module

Files moved to src_py/autogen/:
- CppHeadersExporter.py and ErlHeadersExporter.py (main exporters)
- All dependencies: CppHeadersExporterDefs.py, ErlHeadersExporterDefs.py,
  JsonDistributedConfigDefs.py, JsonElementWorkerDefinitions.py,
  JsonElementsDefinitions.py, Definitions.py, logger.py
@leondavi leondavi requested a review from GuyPerets106 as a code owner October 9, 2025 22:07
@leondavi
Copy link
Copy Markdown
Owner Author

leondavi commented Oct 9, 2025

  • Moved autogeneration scripts from src_py/nerlPlanner/ to src_py/autogen/
  • Updated NerlnetBuild.sh to use new autogen directory paths
  • Changed generated comments from 'Generated by Nerlplanner' to 'Generated by autogen'
  • Organized all auto-generation functionality in dedicated autogen library
  • Added README.md documentation for the autogen module

Files moved to src_py/autogen/:

  • CppHeadersExporter.py and ErlHeadersExporter.py (main exporters)
  • All dependencies: CppHeadersExporterDefs.py, ErlHeadersExporterDefs.py,
    JsonDistributedConfigDefs.py, JsonElementWorkerDefinitions.py,
    JsonElementsDefinitions.py, Definitions.py, logger.py

@leondavi leondavi changed the title Feature/UI Feature/UI Restructure autogeneration scripts: Move to src_py/autogen directory Oct 9, 2025
- Fixed layer type dropdown to show 'ID - Name' format instead of just numbers
- Changed get_layer_type_options_for_display() from dict to list for NiceGUI compatibility
- Updated layer type name from 'CNN/Conv' to 'Conv' for consistency
- Added missing update_layer_sizes_count() method to fix layer addition errors
- Added debugging to render_network_diagram() for troubleshooting
- Fixed layer type extraction logic in add_visual_layer() method
- Updated all layer type comparisons to use correct display names
…rkX + Plotly)

- Added networkx, plotly, and kaleido dependencies to requirements
- Implemented interactive graph visualization with pan/zoom/hover
- Color-coded layers by type (Perceptron: green, Conv: purple, Pooling: orange, etc.)
- Graph displays layer connections, sizes, and activation functions
- Increased graph size to 600px for better visibility
- Simplified canvas structure by removing scroll area conflicts
- Added proper empty state when no layers exist
- Clean, professional visualization with proper margins and styling
…function selectors

- Implement NetworkX + Plotly interactive network visualization in Worker Designer
- Add layer-specific activation/method selectors for all layer types:
  * Perceptron: 11 activation function options
  * Pooling: 3 pooling method options
  * Probabilistic: 4 method options
  * Scaling: 5 scaler method options
- Increase network diagram size to 600px for better visibility
- Fix file upload error when handling callable content attributes
- Add nerlPlanner PySide6 migration files for Qt6 upgrade
- Expanded neural network visualization width for better page fitting
- Replaced logo with NerlnetLogo.png and updated header styling (white background, dark red title)
- Implemented comprehensive button color scheme change from various colors to black
- Added complete Jupyter Lab integration with launch/stop functionality
- Created URL dialog system with loading screen, real URL detection, and clickable links
- Enhanced dialog with copy functionality and proper error handling
- Improved Jupyter Lab startup monitoring with 15-second loading time
- Fixed all UI component styling for consistent black button theme across all designers
- Enhanced JSON file detection for different formats (connectionsMap, experiments, distributed configs)
- Added comprehensive error handling and debugging output for JSON import process
- Fixed connection model to handle legacy connectionsMap format from JSON files
- Improved experiment designer with robust data validation and type checking
- Added detailed stack traces and type information for debugging JSON loading issues
- Enhanced source pieces rendering with better error handling for malformed data
- Added data sanitization to prevent 'method' objects causing len() errors
- Improved fallback detection for auto-importing different JSON file types
- Enhanced existing server detection with URL verification
- Added proper HTTP request validation for Jupyter URLs
- Implemented dialog state management to prevent multiple dialogs
- Added comprehensive debugging for Jupyter server connectivity
- Fixed stale process detection that caused accessibility issues
- Added initial status checking on application startup
- Improved error handling and user feedback for Jupyter operations
- Increased height of saved architectures list box from max-h-48 to max-h-80 for better visibility
- Added ClientDefinition model to DistributedConfigModel with proper Pydantic fields
- Fixed 'Add Client' button functionality by implementing proper model methods
- Added comprehensive worker conflict validation to prevent workers from being assigned to multiple clients
- Implemented real-time validation feedback in client add/edit dialogs
- Enhanced client edit functionality with proper conflict checking
- Added informational guidance for users about worker assignment rules
- Removed duplicate methods in worker_designer.py for cleaner codebase
- Updated JSON serialization methods to handle both object and dictionary formats
- Replace all hardcoded mappings in worker_designer.py with official autogen imports
- Import LayerTypeMap, ActivationFunctionsMap, ModelTypeMapping, OptimizerTypeMapping, LossMethodMapping, DistributedSystemTypeMapping, InfraTypeMapping, PoolingMethodMap, ProbabilisticActivationFunctionMap, ScalingMethodMap from src_py.autogen.JsonElementWorkerDefinitions
- Update all get_*_options() methods to use autogen definitions instead of hardcoded dictionaries
- Maintain consistent display formatting while using official codes and IDs
- Ensure backward compatibility with existing UI components and JSON processing
- Fix import path and distributed system type mapping for proper application startup
- All definitions now come from single source of truth, preventing inconsistencies and code drift
- Preserve documentation strings and method signatures for API compatibility
…ection system

- Transform Graph Visualizer into comprehensive interactive network designer
- Add component palette with 6 component types (Device, Router, Client, Worker, Source, Server)
- Implement Connection Mode for interactive linking between components
- Add component property management with type-specific configuration dialogs
- Integrate bidirectional sync with Distributed Config model
- Enhanced visual representation with color-coded components and selection indicators
- Add context menus for component operations (edit, delete, mark as source/target)
- Implement connection management with visual connection lines and deletion controls
- Add comprehensive graph information panel with real-time statistics
- Support for loading from DC config and syncing changes back
- Include sample network loading for demonstration
- Enhanced error handling and user feedback throughout
- Maintain backward compatibility with existing export/reset functionality

Key Features:
✨ Interactive component addition through intuitive dialog system
🔗 Visual connection creation between components in Connection Mode
⚙️ Property editing for all component types with validation
🔄 Seamless integration with Distributed Configuration designer
📊 Real-time graph statistics and component tracking
🎨 Enhanced visual styling with component type differentiation
🛡️ Comprehensive error handling and user guidance

This transforms the Graph View from a static visualization into a fully
interactive network topology designer, enabling users to visually construct
and manage their distributed system architectures.
@leondavi leondavi merged commit 328d9d3 into master Dec 31, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant