chore: Release v0.5.2

Critical bug fixes for coordinate detection and JSON serialization

- Fixed JSON serialization error in find_by_type
- Improved TextField coordinate detection
- Added coordinatesReliable flag for better targeting

Author: GitLab CI

CHANGELOG.md

@@ -1,3 +1,52 @@
+## 0.5.2
+
+**Critical bug fixes for coordinate detection and JSON serialization**
+
+### 🐛 Bug Fixes (Critical)
+- 🔧 **Fixed JSON Serialization Error in find_by_type**: Added `safeRound()` helper to handle NaN/Infinity values
+  - Previously crashed with "Unsupported object: NaN" or "Unsupported object: Infinity"
+  - Now safely converts all coordinate values to finite integers
+  - Consistent with `inspect()` implementation
+
+- 📍 **Improved TextField Coordinate Detection**: Added reliability detection for widget coordinates
+  - New `coordinatesReliable` flag on all elements
+  - Detects when TextFields report false (0,0) coordinates
+  - Provides warning message: "Coordinates may be unreliable - use key or text for targeting"
+  - Helps AI agents know when to fall back to key/text-based targeting
+
+### 🔧 Improvements
+- 📋 **Enhanced MCP Tool Descriptions**: Updated `inspect` and `find_by_type` documentation
+  - Documents `coordinatesReliable` flag in output format
+  - Warns about TextField coordinate issues
+  - Guides AI agents to use keys when coordinates are unreliable
+
+### 💡 Benefits
+- ✅ find_by_type no longer crashes on off-screen or animated widgets
+- ✅ AI agents can detect unreliable coordinates and adjust targeting strategy
+- ✅ Better error messages guide users to use keys instead of coordinates
+- ✅ More robust JSON serialization prevents crashes
+
+### 📝 Migration Guide
+No breaking changes. New `coordinatesReliable` field is optional to check:
+
+```dart
+// Check coordinate reliability before using coordinates
+final elements = await inspect();
+for (final element in elements) {
+  if (element['coordinatesReliable'] == true) {
+    // Safe to use bounds/center coordinates
+    tap(x: element['center']['x'], y: element['center']['y']);
+  } else {
+    // Fall back to key/text targeting
+    if (element['key'] != null) {
+      tap(key: element['key']);
+    }
+  }
+}
+```
+
+---
+
 ## 0.5.1
 
 **Major usability improvements for screenshots, errors, and logging**

README.md

@@ -262,7 +262,7 @@ flutter-skill launch /path/to/project
 1. Add dependency:
 ```yaml
 dependencies:
-  flutter_skill: ^0.5.1
+  flutter_skill: ^0.5.2
 ```
 
 2. Initialize in main.dart:

intellij-plugin/build.gradle.kts

@@ -5,7 +5,7 @@ plugins {
 }
 
 group = "com.aidashboad"
-version = "0.5.1"
+version = "0.5.2"
 
 repositories {
     mavenCentral()

intellij-plugin/src/main/resources/META-INF/plugin.xml

@@ -1,7 +1,7 @@
 <idea-plugin>
     <id>com.aidashboad.flutterskill</id>
     <name>Flutter Skill - AI App Automation</name>
-    <version>0.5.1</version>
+    <version>0.5.2</version>
     <vendor email="support@ai-dashboad.com" url="https://github.com/ai-dashboad/flutter-skill">ai-dashboad</vendor>
 
     <description><![CDATA[

lib/flutter_skill.dart

@@ -1507,6 +1507,20 @@ class FlutterSkillBinding {
             return value.round();
           }
 
+          // Detect if coordinates are reliable (not (0,0) unless widget is actually at origin)
+          final isAtOrigin = offset.dx == 0 && offset.dy == 0;
+          final hasValidSize =
+              renderObject.size.width > 0 && renderObject.size.height > 0;
+          final isFinite = offset.dx.isFinite && offset.dy.isFinite;
+
+          // For TextFields, check if they're genuinely at origin or just not laid out
+          bool coordinatesReliable = isFinite && hasValidSize;
+          if (isAtOrigin && (widget is TextField || widget is TextFormField)) {
+            // TextField at (0,0) is suspicious - likely not fully laid out
+            // Check if there are other widgets to compare against
+            coordinatesReliable = false;
+          }
+
           entry['bounds'] = {
             'x': safeRound(offset.dx),
             'y': safeRound(offset.dy),
@@ -1517,8 +1531,14 @@ class FlutterSkillBinding {
             'x': safeRound(offset.dx + renderObject.size.width / 2),
             'y': safeRound(offset.dy + renderObject.size.height / 2),
           };
-          entry['visible'] =
-              renderObject.size.width > 0 && renderObject.size.height > 0;
+          entry['visible'] = hasValidSize;
+          entry['coordinatesReliable'] = coordinatesReliable;
+
+          // Add warning for unreliable coordinates
+          if (!coordinatesReliable && isAtOrigin) {
+            entry['warning'] =
+                'Coordinates may be unreliable - widget might not be fully laid out. Use key or text for targeting.';
+          }
         }
 
         results.add(entry);
@@ -1676,11 +1696,30 @@ class FlutterSkillBinding {
         final renderObject = element.renderObject;
         if (renderObject is RenderBox && renderObject.hasSize) {
           final offset = renderObject.localToGlobal(Offset.zero);
-          node['position'] = {'x': offset.dx, 'y': offset.dy};
+
+          // Helper function to safely convert double to int, handling Infinity/NaN
+          int safeRound(double value) {
+            if (!value.isFinite) return 0;
+            return value.round();
+          }
+
+          // Use safeRound to prevent JSON serialization errors
+          node['position'] = {
+            'x': safeRound(offset.dx),
+            'y': safeRound(offset.dy)
+          };
           node['size'] = {
-            'width': renderObject.size.width,
-            'height': renderObject.size.height
+            'width': safeRound(renderObject.size.width),
+            'height': safeRound(renderObject.size.height)
           };
+
+          // Add coordinate reliability flag
+          final isReliable = offset.dx.isFinite &&
+                            offset.dy.isFinite &&
+                            (offset.dx != 0 || offset.dy != 0) &&
+                            renderObject.size.width > 0 &&
+                            renderObject.size.height > 0;
+          node['coordinatesReliable'] = isReliable;
         }
 
         results.add(node);

lib/src/cli/server.dart

@@ -7,7 +7,7 @@ import '../flutter_skill_client.dart';
 import '../diagnostics/error_reporter.dart';
 import 'setup.dart';
 
-const String _currentVersion = '0.5.1';
+const String _currentVersion = '0.5.2';
 
 /// Session information for multi-session support
 class SessionInfo {
@@ -503,6 +503,18 @@ Discover and list all interactive UI elements currently visible on screen (butto
 [WORKFLOW]
 Essential first step for any UI interaction. Returns element list with keys/texts for use with tap() and enter_text().
 
+[OUTPUT FORMAT]
+Each element includes:
+• key: Element identifier for targeting
+• type: Widget type (Button, TextField, etc.)
+• bounds/center: Position coordinates
+• coordinatesReliable: Boolean flag indicating if coordinates are trustworthy
+• warning: Present if coordinates are unreliable (e.g., TextField at (0,0))
+
+[IMPORTANT]
+⚠️ TextFields may report (0,0) coordinates if not fully laid out. Check 'coordinatesReliable' flag.
+   When false, use 'key' or 'text' for targeting instead of coordinates.
+
 [MULTI-SESSION]
 All action tools support optional session_id parameter. If omitted, uses the active session.
 """,
@@ -547,7 +559,27 @@ All action tools support optional session_id parameter. If omitted, uses the act
       },
       {
         "name": "find_by_type",
-        "description": "Find widgets by type name",
+        "description": """Find widgets by type name
+
+[PRIMARY PURPOSE]
+Search for all widgets matching a specific type (e.g., "TextField", "Button", "ListTile").
+
+[USAGE]
+find_by_type(type: "TextField")  // Finds all TextFields
+find_by_type(type: "Button")     // Finds all button types
+
+[OUTPUT FORMAT]
+Returns list of widgets with:
+• type: Full widget type name
+• key: Element identifier if available
+• position: {x, y} coordinates
+• size: {width, height} dimensions
+• coordinatesReliable: Boolean - true if coordinates are trustworthy
+
+[IMPORTANT]
+⚠️ Check 'coordinatesReliable' flag before using coordinates for tap/click actions.
+   If false, use 'key' property for reliable targeting.
+""",
         "inputSchema": {
           "type": "object",
           "properties": {

npm/package.json

@@ -1,6 +1,6 @@
 {
   "name": "flutter-skill-mcp",
-  "version": "0.5.1",
+  "version": "0.5.2",
   "description": "MCP Server for Flutter app automation - Give your AI Agent eyes and hands inside your Flutter app",
   "main": "index.js",
   "bin": {

pubspec.yaml

@@ -1,6 +1,6 @@
 name: flutter_skill
 description: Give your AI Agent eyes and hands inside your Flutter app.
-version: 0.5.1
+version: 0.5.2
 homepage: https://github.com/ai-dashboad/flutter-skill
 repository: https://github.com/ai-dashboad/flutter-skill
 # publish_to: 'none' # Remove this when ready to publish to pub.dev

vscode-extension/package.json

@@ -2,7 +2,7 @@
   "name": "flutter-skill",
   "displayName": "Flutter Skill - AI App Automation",
   "description": "Give your AI Agent eyes and hands inside your Flutter app. Bridge between AI coding assistants (Claude Code, Cursor, Windsurf) and running Flutter applications with 25+ MCP tools for UI inspection, gestures, screenshots, and more.",
-  "version": "0.5.1",
+  "version": "0.5.2",
   "publisher": "ai-dashboad",
   "icon": "images/icon.png",
   "repository": {