Skip to content

Commit b00af75

Browse files
committed
docs: Update README and Docker README for v1.9.3 Enhanced Virtual Tables
📚 COMPREHENSIVE DOCUMENTATION UPDATE: 📖 MAIN README UPDATES: - Update version to v1.9.3 with timestamp - Add Enhanced Virtual Tables to overview and key features - Add comprehensive Enhanced Virtual Tables section with: * Detailed tool documentation (create_enhanced_csv_table, analyze_csv_schema, etc.) * Smart Type Inference Engine explanation * JSON Collection Virtual Tables with flattening * Example workflows for CSV and JSON import * Advanced features and performance benefits - Update tool count from 40 to 44 tools - Move Enhanced CSV/JSON from planned to implemented features - Update planned enhancements with new future priorities 🐳 DOCKER README UPDATES: - Update version to v1.9.3 in header - Add Enhanced Virtual Tables to key features - Update tool count to 44 with enhanced virtual table capabilities ✨ HIGHLIGHTS: - Smart data import with automatic type inference now documented - Complete workflow examples for CSV and JSON processing - Clear explanation of nested object flattening capabilities - Performance and configuration options detailed Documentation now reflects the intelligent data import capabilities and enhanced virtual table features in v1.9.3.
1 parent 20ee8ed commit b00af75

File tree

2 files changed

+114
-10
lines changed

2 files changed

+114
-10
lines changed

README-Docker.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# SQLite MCP Server
22

3-
*Last Updated September 17, 2025 12:39 AM EST - v1.9.2*
3+
*Last Updated September 17, 2025 1:10 AM EST - v1.9.3*
44

55
*Lightweight, containerized SQLite database server with AI-native features*
66

@@ -73,6 +73,7 @@ docker run -i --rm \
7373
- **JSON Validation**: Prevents invalid JSON from being stored in the database
7474
- **Comprehensive Schema Tools**: Enhanced tools for exploring and documenting database structure
7575
- **Database Administration Tools**: Complete suite of maintenance tools including VACUUM, ANALYZE, integrity checks, performance statistics, and index usage analysis
76+
- **Enhanced Virtual Tables**: Smart CSV/JSON import with automatic data type inference and schema analysis (44 tools total)
7677
- **Full-Text Search (FTS5)**: Comprehensive FTS5 implementation with table creation, index management, and enhanced search with BM25 ranking and snippets
7778
- **Backup/Restore Operations**: Enterprise-grade backup and restore capabilities with SQLite backup API, integrity verification, and safety confirmations
7879
- **Advanced PRAGMA Operations**: Comprehensive SQLite configuration management, performance optimization, and database introspection tools

README.md

Lines changed: 112 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,10 @@
11
# SQLite MCP Server
22

3-
*Last Updated September 17, 2025 11:55 PM EST - v1.9.2*
3+
*Last Updated September 17, 2025 1:10 AM EST - v1.9.3*
44

55
## Overview
66

7-
The SQLite MCP Server provides advanced database interaction and business intelligence capabilities through SQLite featuring Vector Index Optimization with ANN search, Intelligent MCP Resources and Prompts, Semantic/Vector Search, Virtual Table Management, Advanced PRAGMA Operations, Backup/Restore operations, Full-Text Search (FTS5), enhanced JSONB support for improved JSON storage efficiency, transaction safety for all database operations, foreign key constraint enforcement, enhanced error handling, and detailed diagnostics.
7+
The SQLite MCP Server provides advanced database interaction and business intelligence capabilities through SQLite featuring Enhanced Virtual Tables with Smart Type Inference, Vector Index Optimization with ANN search, Intelligent MCP Resources and Prompts, Semantic/Vector Search, Virtual Table Management, Advanced PRAGMA Operations, Backup/Restore operations, Full-Text Search (FTS5), enhanced JSONB support for improved JSON storage efficiency, transaction safety for all database operations, foreign key constraint enforcement, enhanced error handling, and detailed diagnostics.
88

99
## Key Features
1010

@@ -23,6 +23,7 @@ The SQLite MCP Server provides advanced database interaction and business intell
2323
- **Backup/Restore Operations**: Enterprise-grade backup and restore capabilities with SQLite backup API, integrity verification, and safety confirmations
2424
- **Advanced PRAGMA Operations**: Comprehensive SQLite configuration management, performance optimization, and database introspection tools
2525
- **Virtual Table Management**: Complete virtual table lifecycle management for R-Tree spatial indexing, CSV file access, and sequence generation
26+
- **Enhanced Virtual Tables**: Smart CSV/JSON import with automatic data type inference, nested object flattening, and schema analysis
2627
- **Semantic/Vector Search**: AI-native semantic search with embedding storage, cosine similarity, and hybrid keyword+semantic ranking
2728
- **Vector Index Optimization**: Approximate Nearest Neighbor (ANN) search with k-means clustering and spatial indexing for sub-linear O(log n) performance
2829
- **Intelligent MCP Resources**: Dynamic database meta-awareness with real-time schema, capabilities, statistics, search indexes, and performance insights
@@ -1092,6 +1093,108 @@ embedding = model.encode("Your content").tolist()
10921093
store_embedding(table_name="hf_embeddings", embedding=embedding, content="Your content")
10931094
```
10941095

1096+
## Enhanced Virtual Tables
1097+
1098+
The SQLite MCP Server provides intelligent data import capabilities with automatic schema detection, type inference, and seamless conversion of CSV and JSON files into queryable SQLite tables.
1099+
1100+
### Enhanced CSV Virtual Tables
1101+
1102+
**`create_enhanced_csv_table`** - Smart CSV import with automatic data type inference
1103+
```javascript
1104+
create_enhanced_csv_table({
1105+
"table_name": "employees",
1106+
"csv_file_path": "/path/to/employees.csv",
1107+
"delimiter": ",", // CSV delimiter (default: comma)
1108+
"has_header": true, // Whether CSV has header row
1109+
"sample_rows": 100, // Rows to sample for type inference
1110+
"null_values": ["", "NULL", "N/A"] // Values to treat as NULL
1111+
})
1112+
```
1113+
1114+
**`analyze_csv_schema`** - Deep CSV analysis without creating tables
1115+
```javascript
1116+
analyze_csv_schema({
1117+
"csv_file_path": "/path/to/data.csv",
1118+
"sample_rows": 1000 // Rows to analyze for schema detection
1119+
})
1120+
// Returns: file stats, column analysis, type confidence, sample values
1121+
```
1122+
1123+
### JSON Collection Virtual Tables
1124+
1125+
**`create_json_collection_table`** - Import JSONL and JSON array files with flattening
1126+
```javascript
1127+
create_json_collection_table({
1128+
"table_name": "user_events",
1129+
"json_file_path": "/path/to/events.jsonl",
1130+
"format_type": "auto", // auto, jsonl, json_array
1131+
"flatten_nested": true, // Flatten nested objects with dot notation
1132+
"max_depth": 3, // Maximum nesting depth to flatten
1133+
"sample_records": 100 // Records to sample for schema inference
1134+
})
1135+
```
1136+
1137+
**`analyze_json_schema`** - Comprehensive JSON structure analysis
1138+
```javascript
1139+
analyze_json_schema({
1140+
"json_file_path": "/path/to/data.jsonl",
1141+
"format_type": "auto", // Auto-detect JSONL vs JSON array
1142+
"sample_records": 1000 // Records to analyze
1143+
})
1144+
// Returns: schema analysis, type distribution, nested structure mapping
1145+
```
1146+
1147+
### Smart Type Inference Engine
1148+
1149+
**Automatic Data Type Detection:**
1150+
- **INTEGER**: Detects whole numbers, IDs, counts
1151+
- **REAL**: Identifies decimals, percentages, measurements
1152+
- **TEXT**: Handles strings, mixed content, complex data
1153+
- **DATE**: Recognizes ISO dates, common date formats
1154+
- **BOOLEAN**: Converts true/false, yes/no, 1/0 patterns
1155+
1156+
**Advanced Features:**
1157+
- **Configurable Null Handling**: Customizable null value patterns
1158+
- **Statistical Analysis**: Type confidence based on sample data
1159+
- **Clean Column Names**: Automatic SQL-safe column naming
1160+
- **Error Resilience**: Graceful handling of malformed data
1161+
- **Performance Optimized**: Configurable sampling for large files
1162+
1163+
### Example Workflows
1164+
1165+
**CSV Data Import:**
1166+
```javascript
1167+
// 1. Analyze CSV structure first
1168+
analyze_csv_schema({"csv_file_path": "./sales_data.csv"})
1169+
1170+
// 2. Create table with inferred types
1171+
create_enhanced_csv_table({
1172+
"table_name": "sales",
1173+
"csv_file_path": "./sales_data.csv",
1174+
"sample_rows": 500
1175+
})
1176+
1177+
// 3. Query your data immediately
1178+
SELECT product, SUM(amount) FROM sales GROUP BY product
1179+
```
1180+
1181+
**JSON Collection Import:**
1182+
```javascript
1183+
// 1. Analyze nested JSON structure
1184+
analyze_json_schema({"json_file_path": "./user_logs.jsonl"})
1185+
1186+
// 2. Create flattened table
1187+
create_json_collection_table({
1188+
"table_name": "user_activity",
1189+
"json_file_path": "./user_logs.jsonl",
1190+
"flatten_nested": true,
1191+
"max_depth": 2
1192+
})
1193+
1194+
// 3. Query flattened data
1195+
SELECT user_id, event_type, metadata_browser FROM user_activity
1196+
```
1197+
10951198
## Vector Index Optimization
10961199

10971200
The SQLite MCP Server provides enterprise-grade vector index optimization with Approximate Nearest Neighbor (ANN) search capabilities, transforming vector similarity search from O(n) linear to O(log n) sub-linear performance for massive datasets.
@@ -1208,7 +1311,7 @@ MCP Resources provide dynamic "knowledge hooks" that give the AI model instant a
12081311
**`database://capabilities`** - Comprehensive server capabilities matrix
12091312
```javascript
12101313
// Provides real-time information about:
1211-
// - Available tools (40 total)
1314+
// - Available tools (44 total)
12121315
// - Feature support (FTS5, semantic search, virtual tables)
12131316
// - Advanced features and limitations
12141317
// - Server and SQLite versions
@@ -1282,13 +1385,13 @@ MCP Prompts provide intelligent workflow automation, acting as "recipes" that gu
12821385

12831386
## Planned Future Enhancements
12841387

1285-
#### **1. Enhanced CSV Virtual Tables - MEDIUM PRIORITY**
1286-
- **Planned**: Advanced CSV parsing with data type inference
1287-
- **Examples**: Automatic schema detection, column type conversion
1388+
#### **1. Advanced Data Connectors - MEDIUM PRIORITY**
1389+
- **Planned**: Direct database connectors (PostgreSQL, MySQL, MongoDB)
1390+
- **Examples**: Cross-database queries, data synchronization
12881391

1289-
#### **2. JSON Virtual Tables - LOW PRIORITY**
1290-
- **Planned**: Virtual tables for JSON file collections
1291-
- **Examples**: JSON Lines (JSONL) file processing
1392+
#### **2. Real-time Data Streaming - LOW PRIORITY**
1393+
- **Planned**: Live data ingestion from streaming sources
1394+
- **Examples**: Kafka, WebSocket, API polling integration
12921395

12931396
## Contributing
12941397

0 commit comments

Comments
 (0)