Updated package v4.9 and updated Docs

Author: UtkarshTheDev

CHANGELOG.md

@@ -2,6 +2,34 @@
 
 All notable changes to LocalLab will be documented in this file.
 
+## 0.4.9 - 2025-03-11
+
+### Fixed
+
+- Fixed critical issue with `locallab config` command not being respected when running `locallab start`
+- Enhanced configuration system to properly load and apply saved settings
+- Improved user experience by showing current configuration before prompting for changes
+- Added clear feedback when configuration is saved and how to use it
+
+## 0.4.8 - 2025-03-10
+
+### Fixed
+
+- Fixed critical server startup error related to missing 'lifespan' attribute in ServerWithCallback class
+- Fixed KeyError in 'locallab info' command by properly handling RAM information
+- Significantly improved CLI startup speed through lazy loading of imports
+- Enhanced error handling in system information display
+- Fixed environment variable conflicts between CLI configuration and OS environment variables
+- Improved configuration system to properly handle both CLI and environment variable settings
+- Optimized server startup process for faster response time
+
+### Changed
+
+- Reduced unnecessary operations during CLI startup for better performance
+- Improved memory usage reporting with proper unit conversion (GB instead of MB)
+- Enhanced ServerWithCallback class with proper lifespan initialization
+- Updated configuration system to use a unified approach for all settings
+
 ## 0.4.7 - 2025-03-08
 
 ### Added

README.md

@@ -7,6 +7,13 @@
 
 LocalLab empowers users to run any Hugging Face AI model locally or on Google Colab with minimal setup required. It automatically configures an API using ngrok, enabling seamless integration into applications from any location. Designed for simplicity, LocalLab makes advanced AI accessible to all, regardless of technical expertise. With built-in model management, performance optimizations, and system monitoring, it ensures efficient and reliable AI operations for developers, researchers, and enthusiasts alike.
 
+## What's New in v0.4.9
+
+- **🔧 Fixed Configuration System**: The `locallab config` command now properly saves settings that are respected when running `locallab start`
+- **📋 Configuration Display**: The CLI now shows your current configuration before prompting for changes
+- **⏩ Skip Unnecessary Prompts**: Only prompts for settings that aren't already configured
+- **✅ Clear Feedback**: After saving configuration, the CLI shows what was saved and how to use it
+
 ## What Problem Does LocalLab Solve?
 
 - **Local Inference:** Run advanced language models without relying on expensive cloud services.
@@ -38,12 +45,14 @@ LocalLab empowers users to run any Hugging Face AI model locally or on Google Co
 
 ## Key Features
 
+- **Interactive CLI:** Configure and run your server with an intuitive command-line interface that adapts to your environment.
 - **Multiple Model Support:** Pre-configured models along with the ability to load custom ones on demand.
 - **Advanced Optimizations:** Support for FP16, INT8, and INT4 quantization, Flash Attention, and attention slicing.
 - **Comprehensive Logging System:** Colorized console output with server status tracking, request monitoring, and performance metrics.
 - **Robust Resource Monitoring:** Real-time insights into system performance and resource usage.
 - **Flexible Client Libraries:** Comprehensive clients available for both Python and Node.js.
 - **Google Colab Friendly:** Dedicated workflow for deploying via Google Colab with public URL access.
+- **Persistent Configuration:** Save your settings for future use with the new configuration system.
 
 ## Unique Visual Overview
 
@@ -77,6 +86,7 @@ sequenceDiagram
 For full documentation and detailed guides, please visit our [documentation page](https://github.com/Developer-Utkarsh/LocalLab/blob/main/docs/README.md).
 
 - [Getting Started Guide](https://github.com/Developer-Utkarsh/LocalLab/blob/main/docs/guides/getting-started.md)
+- [CLI Guide](https://github.com/Developer-Utkarsh/LocalLab/blob/main/docs/guides/cli.md)
 - [Python Client](https://github.com/Developer-Utkarsh/LocalLab/blob/main/docs/clients/python/README.md)
 - [Node.js Client](https://github.com/Developer-Utkarsh/LocalLab/blob/main/docs/clients/nodejs/README.md)
 - [Client Comparison](https://github.com/Developer-Utkarsh/LocalLab/blob/main/docs/clients/comparison.md)
@@ -91,14 +101,30 @@ For full documentation and detailed guides, please visit our [documentation page
    pip install locallab
    ```
 
-2. **Starting the Server Locally:**
+2. **Using the CLI (New!):**
+
+   ```bash
+   # Start the server with interactive configuration
+   locallab start
+
+   # Start with specific options
+   locallab start --model microsoft/phi-2 --quantize --quantize-type int8
+
+   # Run the configuration wizard without starting the server
+   locallab config
+
+   # Display system information
+   locallab info
+   ```
+
+3. **Starting the Server Programmatically:**
 
    ```python
    from locallab import start_server
    start_server()
    ```
 
-3. **Starting the Server on Google Colab:**
+4. **Starting the Server on Google Colab:**
 
    ```python
    !pip install locallab
@@ -117,7 +143,7 @@ For full documentation and detailed guides, please visit our [documentation page
    start_server(use_ngrok=True)  # Creates a public URL accessible from anywhere
    ```
 
-4. **Connecting your Client:**
+5. **Connecting your Client:**
 
    ```python
    from locallab.client import LocalLabClient
@@ -130,6 +156,33 @@ For full documentation and detailed guides, please visit our [documentation page
    print(response)
    ```
 
+## CLI Features (New in v0.4.8!)
+
+LocalLab now includes a powerful command-line interface with the following features:
+
+- **Interactive Configuration:** Guided setup for all server settings
+- **Environment Detection:** Smart defaults based on your system
+- **Persistent Settings:** Configuration stored in `~/.locallab/config.json`
+- **System Information:** Detailed insights about your hardware
+- **Performance Optimizations:** Easy configuration of quantization and other optimizations
+- **Google Colab Integration:** Automatic detection and configuration for Colab environments
+
+Example CLI usage:
+
+```bash
+# Start with interactive prompts
+locallab start
+
+# Configure with specific options
+locallab start --model microsoft/phi-2 --port 8080 --quantize --attention-slicing
+
+# Run configuration wizard
+locallab config
+
+# Check system resources
+locallab info
+```
+
 ## Join the Community
 
 - Report issues on our [GitHub Issues](https://github.com/Developer-Utkarsh/LocalLab/issues).

docs/README.md

@@ -6,6 +6,29 @@ Welcome to the LocalLab documentation! This guide is your one-stop resource for
 
 LocalLab empowers you to run AI inference servers either locally or through Google Colab. With advanced model management, performance optimizations, and robust system monitoring, LocalLab is built to deliver efficient, on-demand AI capabilities.
 
+## What's New in v0.4.9
+
+Our latest release brings significant improvements to the configuration system:
+
+- **🔧 Fixed Configuration Persistence**: The `locallab config` command now properly saves settings that are respected when running `locallab start`
+- **📋 Configuration Display**: The CLI now shows your current configuration before prompting for changes
+- **⏩ Skip Unnecessary Prompts**: Only prompts for settings that aren't already configured
+- **✅ Clear Feedback**: After saving configuration, the CLI shows what was saved and how to use it
+
+[Read the full changelog](../CHANGELOG.md) for more details.
+
+## What's New in v0.4.8
+
+Our previous release brought significant improvements to the LocalLab CLI:
+
+- **⚡ Lightning-Fast Startup**: Optimized for quick response time with lazy loading
+- **🛡️ Robust Error Handling**: Better diagnostics and recovery from common issues
+- **🔄 Unified Configuration**: Seamless integration between CLI options and environment variables
+- **📊 Enhanced System Information**: Improved hardware reporting with the `locallab info` command
+- **🔧 Fixed Critical Issues**: Resolved server startup errors and configuration conflicts
+
+[Read the full changelog](../CHANGELOG.md) for more details.
+
 ## Visual Overview
 
 ### Architecture Diagram

docs/guides/cli.md

@@ -11,6 +11,8 @@ LocalLab provides a powerful command-line interface (CLI) that makes it easy to
 5. [Environment Variables](#environment-variables)
 6. [Configuration Storage](#configuration-storage)
 7. [Google Colab Integration](#google-colab-integration)
+8. [New in v0.4.9](#new-in-v049)
+9. [New in v0.4.8](#new-in-v048)
 
 ## Installation
 
@@ -85,7 +87,7 @@ Example interactive session:
 
 🔧 Would you like to configure advanced options? [y/N]:
 
-✅ Configuration complete! Starting server...
+✅ Configuration complete!
 ```
 
 ## Command Reference
@@ -114,14 +116,29 @@ locallab start --model microsoft/phi-2 --quantize --quantize-type int8
 
 ### `locallab config`
 
-Run the configuration wizard without starting the server.
+Run the configuration wizard without starting the server. This command now shows your current configuration and allows you to modify it.
 
 Example:
 
 ```bash
 locallab config
 ```
 
+Output:
+
+```
+📋 Current Configuration:
+  port: 8000
+  model_id: microsoft/phi-2
+  enable_quantization: true
+  quantization_type: int8
+  enable_attention_slicing: true
+  enable_flash_attention: false
+  enable_better_transformer: false
+
+Would you like to reconfigure these settings? [Y/n]:
+```
+
 ### `locallab info`
 
 Display system information.
@@ -179,6 +196,92 @@ start_server(use_ngrok=True, port=8080)
 
 The CLI will detect that it's running in Colab and prompt for any missing required settings, such as the ngrok authentication token if `use_ngrok=True` is specified.
 
+## New in v0.4.9
+
+Version 0.4.9 brings significant improvements to the configuration system:
+
+### 🔄 Persistent Configuration That Works
+
+- **Fixed Configuration Persistence**: The `locallab config` command now properly saves settings that are respected when running `locallab start`
+- **Configuration Display**: The `config` command now shows your current configuration before prompting for changes
+- **Skip Unnecessary Prompts**: The CLI now only prompts for settings that aren't already configured
+- **Clear Feedback**: After saving configuration, the CLI shows what was saved and how to use it
+
+### 🛠️ Improved Configuration Workflow
+
+```bash
+# Step 1: Configure your settings once
+locallab config
+
+# Step 2: Start the server using your saved configuration
+locallab start
+```
+
+With this improved workflow, you only need to configure your settings once, and they'll be remembered for future sessions.
+
+### Example Configuration Session
+
+```
+$ locallab config
+
+📋 Current Configuration:
+  port: 8000
+  model_id: microsoft/phi-2
+  enable_quantization: true
+  quantization_type: int8
+  enable_attention_slicing: true
+
+Would you like to reconfigure these settings? [Y/n]: n
+Configuration unchanged.
+
+$ locallab start
+🎮 GPU detected with 8192MB free of 16384MB total
+💾 System memory: 12288MB free of 16384MB total
+
+✅ Using saved configuration!
+```
+
+## New in v0.4.8
+
+Version 0.4.8 brings significant improvements to the CLI:
+
+### ⚡ Lightning-Fast Startup
+
+- **Lazy Loading**: The CLI now uses lazy loading for imports, resulting in much faster startup times
+- **Optimized Initialization**: Reduced unnecessary operations during CLI startup
+- **Faster Response**: Commands like `locallab info` now respond almost instantly
+
+### 🛡️ Improved Error Handling
+
+- **Robust Error Recovery**: Better handling of common errors like missing dependencies
+- **Informative Messages**: More helpful error messages that guide you to solutions
+- **Graceful Fallbacks**: The CLI now gracefully handles missing or invalid configuration values
+
+### 🔄 Unified Configuration System
+
+- **Seamless Integration**: CLI options, environment variables, and configuration files now work together harmoniously
+- **Consistent Behavior**: No more conflicts between different ways of setting configuration values
+- **Clear Precedence**: Environment variables take precedence over saved configuration, which takes precedence over defaults
+
+### 📊 Enhanced System Information
+
+- **Detailed Hardware Info**: The `locallab info` command now provides more detailed information about your system
+- **Better Memory Reporting**: Improved memory usage reporting with proper unit conversion (GB instead of MB)
+- **GPU Details**: More comprehensive GPU information when available
+
+### Example Usage
+
+```bash
+# Start with interactive configuration - now much faster!
+locallab start
+
+# Use the improved system information command
+locallab info
+
+# Configure with specific options - now with better error handling
+locallab start --model microsoft/phi-2 --quantize --quantize-type int8 --attention-slicing
+```
+
 ## Using the CLI in Python Code
 
 You can also use the CLI functionality directly in your Python code:

docs/guides/getting-started.md

@@ -14,14 +14,20 @@ This guide will help you start using LocalLab, whether you're running it locally
 
 2. **Start the Server**
 
-   **Using Command Line (New!)**
+   **Using Command Line (Improved in v0.4.8!)**
 
    ```bash
-   # Interactive setup wizard
+   # Interactive setup wizard - now with faster startup and better error handling
    locallab start
 
    # Or with specific options
-   locallab start --model microsoft/phi-2 --quantize
+   locallab start --model microsoft/phi-2 --quantize --quantize-type int8 --attention-slicing
+
+   # Run the configuration wizard without starting the server
+   locallab config
+
+   # Check your system resources
+   locallab info
    ```
 
    **Using Python**
@@ -54,11 +60,12 @@ This guide will help you start using LocalLab, whether you're running it locally
 
 3. **Start Server**
 
-   **Using Interactive Setup (New!)**
+   **Using Interactive Setup (Enhanced in v0.4.8!)**
 
    ```python
    from locallab import start_server
    # This will prompt for any missing settings, including ngrok token
+   # Now with improved error handling and faster startup
    start_server(use_ngrok=True)
    ```
 
@@ -75,6 +82,32 @@ This guide will help you start using LocalLab, whether you're running it locally
    client = LocalLabClient("https://xxxx-xx-xx-xxx-xx.ngrok-free.app")  # Use URL from logs
    ```
 
+## CLI Features (New & Improved in v0.4.8)
+
+LocalLab's command-line interface has been significantly enhanced with:
+
+- **Lightning-Fast Startup**: Optimized for quick response time
+- **Robust Error Handling**: Better diagnostics and recovery from common issues
+- **Unified Configuration System**: Seamlessly integrates CLI options with environment variables
+- **Persistent Settings**: Your configuration is saved in `~/.locallab/config.json`
+- **System Information Command**: Get detailed insights about your hardware with `locallab info`
+
+```bash
+# Examples of CLI usage
+
+# Start with interactive configuration
+locallab start
+
+# Start with specific model and optimizations
+locallab start --model microsoft/phi-2 --quantize --quantize-type int8
+
+# Configure without starting
+locallab config
+
+# Check system resources
+locallab info
+```
+
 ## First Steps
 
 ### 1. Generate Text