dogfood: Add more dogfooding

Author: antonsynd

dogfood_output/SUMMARY.md

@@ -1,22 +1,30 @@
 # Dogfooding Summary Report
 
-**Generated:** 2026-01-18T13:02:26.538240
+**Generated:** 2026-01-18T13:19:39.235112
 
 ## Overall Statistics
 
 - **Total Iterations:** 10
-- **Successful:** 8 (80.0%)
-- **Failed:** 0 (0.0%)
-- **Skipped:** 2 (20.0%)
+- **Successful:** 2 (20.0%)
+- **Failed:** 7 (70.0%)
+- **Skipped:** 1 (10.0%)
 
 ## Issues by Type
 
-- **skipped:** 2
+- **execution_failed:** 3
+- **output_mismatch:** 4
+- **skipped:** 1
+
+## Recent Failures
+
+- [execution_failed](/Users/anton/Documents/github/sharpy/dogfood_output/issues/20260118_131731_execution_failed_0000) - class_inheritance/medium - 12.9s
+- [output_mismatch](/Users/anton/Documents/github/sharpy/dogfood_output/issues/20260118_131748_output_mismatch_0001) - virtual_override/medium - 17.1s
+- [output_mismatch](/Users/anton/Documents/github/sharpy/dogfood_output/issues/20260118_131843_output_mismatch_0002) - function_calling_function/complex - 21.0s
+- [output_mismatch](/Users/anton/Documents/github/sharpy/dogfood_output/issues/20260118_131859_output_mismatch_0003) - simple_function/simple - 16.1s
+- [execution_failed](/Users/anton/Documents/github/sharpy/dogfood_output/issues/20260118_131912_execution_failed_0004) - virtual_override/medium - 13.1s
+- [execution_failed](/Users/anton/Documents/github/sharpy/dogfood_output/issues/20260118_131923_execution_failed_0005) - enum_usage/simple - 10.6s
+- [output_mismatch](/Users/anton/Documents/github/sharpy/dogfood_output/issues/20260118_131939_output_mismatch_0006) - simple_function/simple - 15.7s
 
 ## Recent Skips
 
-- break_continue/medium - Invalid expected output (Python says: 13
-999
-24
-16)
-- nested_if_in_loop/complex - Generated code invalid per spec
+- module_imports/complex - Unsupported feature in geometry.spy: Line 22: with statement (deferred) - 'return base + " with dimensions " + str(int(self.w...'

dogfood_output/issues/20260118_131731_execution_failed_0000/README.md

@@ -0,0 +1,78 @@
+# Issue Report: execution_failed
+
+**Timestamp:** 2026-01-18T13:17:18.300150
+**Type:** execution_failed
+**Feature Focus:** class_inheritance
+**Complexity:** medium
+**Backend:** claude
+
+## Generated Sharpy Code
+
+```python
+# Test class inheritance with multiple levels and method overriding
+
+@abstract
+class Shape:
+    name: str
+
+    def __init__(self, name: str):
+        self.name = name
+
+    @abstract
+    def area(self) -> float:
+        ...
+
+    @virtual
+    def describe(self) -> None:
+        print(self.name)
+
+class Rectangle(Shape):
+    width: float
+    height: float
+
+    def __init__(self, name: str, width: float, height: float):
+        super().__init__(name)
+        self.width = width
+        self.height = height
+
+    @override
+    def area(self) -> float:
+        return self.width * self.height
+
+class Square(Rectangle):
+    def __init__(self, name: str, side: float):
+        super().__init__(name, side, side)
+
+    @override
+    def describe(self) -> None:
+        super().describe()
+        print(self.width)
+
+rect = Rectangle("MyRectangle", 5.0, 3.0)
+rect.describe()
+print(rect.area())
+
+square = Square("MySquare", 4.0)
+square.describe()
+print(square.area())
+
+# EXPECTED OUTPUT:
+# MyRectangle
+# 15
+# MySquare
+# 4
+# 16
+```
+
+## Error
+
+```
+Compilation failed:
+  Semantic error at line 37, column 9: Parent class 'Rectangle' has no method 'describe'
+
+```
+
+## Timing
+
+- Generation: 4.68s
+- Execution: 1.16s

dogfood_output/issues/20260118_131731_execution_failed_0000/error.txt

@@ -0,0 +1,2 @@
+Compilation failed:
+  Semantic error at line 37, column 9: Parent class 'Rectangle' has no method 'describe'

dogfood_output/issues/20260118_131731_execution_failed_0000/expected_output.txt

@@ -0,0 +1,5 @@
+MyRectangle
+15
+MySquare
+4
+16

dogfood_output/issues/20260118_131731_execution_failed_0000/metadata.json

@@ -0,0 +1,18 @@
+{
+  "issue_type": "execution_failed",
+  "timestamp": "2026-01-18T13:17:18.300150",
+  "generated_code": "# Test class inheritance with multiple levels and method overriding\n\n@abstract\nclass Shape:\n    name: str\n\n    def __init__(self, name: str):\n        self.name = name\n\n    @abstract\n    def area(self) -> float:\n        ...\n\n    @virtual\n    def describe(self) -> None:\n        print(self.name)\n\nclass Rectangle(Shape):\n    width: float\n    height: float\n\n    def __init__(self, name: str, width: float, height: float):\n        super().__init__(name)\n        self.width = width\n        self.height = height\n\n    @override\n    def area(self) -> float:\n        return self.width * self.height\n\nclass Square(Rectangle):\n    def __init__(self, name: str, side: float):\n        super().__init__(name, side, side)\n\n    @override\n    def describe(self) -> None:\n        super().describe()\n        print(self.width)\n\nrect = Rectangle(\"MyRectangle\", 5.0, 3.0)\nrect.describe()\nprint(rect.area())\n\nsquare = Square(\"MySquare\", 4.0)\nsquare.describe()\nprint(square.area())\n\n# EXPECTED OUTPUT:\n# MyRectangle\n# 15\n# MySquare\n# 4\n# 16",
+  "expected_output": "MyRectangle\n15\nMySquare\n4\n16\n",
+  "actual_output": null,
+  "error_message": "Compilation failed:\n  Semantic error at line 37, column 9: Parent class 'Rectangle' has no method 'describe'\n",
+  "compiler_output": "",
+  "generated_cs": null,
+  "validation_result": "```\nVALID\nThe code uses only features from phases 0.1.0-0.1.10.\n```\n\n**Breakdown of features used:**\n\n\u2705 **Classes (0.1.6)**: `class Shape:`, `class Rectangle(Shape):`, `class Square(Rectangle):`\n\u2705 **Inheritance (0.1.7)**: Single inheritance chain `Shape \u2192 Rectangle \u2192 Square`\n\u2705 **Abstract classes/methods (0.1.7)**: `@abstract` decorator on class and `area()` method\n\u2705 **Virtual methods (0.1.7)**: `@virtual` on `describe()`\n\u2705 **Override methods (0.1.7)**: `@override` on `area()` and `describe()`\n\u2705 **Constructor (0.1.6)**: `def __init__(self, ...):` in all classes\n\u2705 **Super calls (0.1.7)**: `super().__init__(...)` and `super().describe()`\n\u2705 **Field declarations (0.1.6)**: `name: str`, `width: float`, `height: float`\n\u2705 **Field access (0.1.6)**: `self.name`, `self.width`, `self.height`\n\u2705 **Type annotations (0.1.3)**: `str`, `float`, `-> float`, `-> None`\n\u2705 **Return statement (0.1.5)**: `return self.width * self.height`\n\u2705 **Built-in print (single argument)**: `print(self.name)`, `print(self.width)`, `print(rect.area())`, `print(square.area())`\n\u2705 **Operators (0.1.3)**: `*` for multiplication\n\u2705 **Variable declaration (0.1.3)**: `rect = ...`, `square = ...`\n\u2705 **Literals (0.1.3)**: String literals `\"MyRectangle\"`, float literals `5.0`, `3.0`, `4.0`\n\nAll features are compliant with phases 0.1.0-0.1.10.\n",
+  "feature_focus": "class_inheritance",
+  "complexity": "medium",
+  "backend_used": "claude",
+  "generation_duration": 4.678782939910889,
+  "compilation_duration": null,
+  "execution_duration": 1.1586449146270752,
+  "source_files": null
+}

dogfood_output/issues/20260118_131731_execution_failed_0000/source.spy

@@ -0,0 +1,53 @@
+# Test class inheritance with multiple levels and method overriding
+
+@abstract
+class Shape:
+    name: str
+
+    def __init__(self, name: str):
+        self.name = name
+
+    @abstract
+    def area(self) -> float:
+        ...
+
+    @virtual
+    def describe(self) -> None:
+        print(self.name)
+
+class Rectangle(Shape):
+    width: float
+    height: float
+
+    def __init__(self, name: str, width: float, height: float):
+        super().__init__(name)
+        self.width = width
+        self.height = height
+
+    @override
+    def area(self) -> float:
+        return self.width * self.height
+
+class Square(Rectangle):
+    def __init__(self, name: str, side: float):
+        super().__init__(name, side, side)
+
+    @override
+    def describe(self) -> None:
+        super().describe()
+        print(self.width)
+
+rect = Rectangle("MyRectangle", 5.0, 3.0)
+rect.describe()
+print(rect.area())
+
+square = Square("MySquare", 4.0)
+square.describe()
+print(square.area())
+
+# EXPECTED OUTPUT:
+# MyRectangle
+# 15
+# MySquare
+# 4
+# 16

dogfood_output/issues/20260118_131748_output_mismatch_0001/README.md

@@ -0,0 +1,111 @@
+# Issue Report: output_mismatch
+
+**Timestamp:** 2026-01-18T13:17:31.225175
+**Type:** output_mismatch
+**Feature Focus:** virtual_override
+**Complexity:** medium
+**Backend:** claude
+
+## Generated Sharpy Code
+
+```python
+# Test virtual and override methods with a simple shape hierarchy
+
+@abstract
+class Shape:
+    name: str
+
+    def __init__(self, name: str):
+        self.name = name
+
+    @virtual
+    def area(self) -> float:
+        return 0.0
+
+    @virtual
+    def perimeter(self) -> float:
+        return 0.0
+
+    def describe(self) -> None:
+        print(self.name)
+        print(self.area())
+        print(self.perimeter())
+
+class Rectangle(Shape):
+    width: float
+    height: float
+
+    def __init__(self, width: float, height: float):
+        super().__init__("Rectangle")
+        self.width = width
+        self.height = height
+
+    @override
+    def area(self) -> float:
+        return self.width * self.height
+
+    @override
+    def perimeter(self) -> float:
+        return 2.0 * (self.width + self.height)
+
+class Circle(Shape):
+    radius: float
+
+    def __init__(self, radius: float):
+        super().__init__("Circle")
+        self.radius = radius
+
+    @override
+    def area(self) -> float:
+        return 3.14 * self.radius * self.radius
+
+    @override
+    def perimeter(self) -> float:
+        return 2.0 * 3.14 * self.radius
+
+rect: Rectangle = Rectangle(5.0, 3.0)
+rect.describe()
+
+circ: Circle = Circle(4.0)
+circ.describe()
+
+# EXPECTED OUTPUT:
+# Rectangle
+# 15.0
+# 16.0
+# Circle
+# 50.24
+# 25.12
+```
+
+## Output Comparison
+
+### Expected
+```
+Rectangle
+15.0
+16.0
+Circle
+50.24
+25.12
+
+```
+
+### Actual
+```
+Successfully compiled to: /var/folders/6r/tsfytt4x6s1cl4_t14c961040000gn/T/dogfood_test_23f0dbc765dd4156bf5a05a80d70d30d.exe
+
+=== Running Program ===
+
+Rectangle
+15
+16
+Circle
+50.24
+25.12
+```
+
+## Timing
+
+- Generation: 5.07s
+- Execution: 1.30s

dogfood_output/issues/20260118_131748_output_mismatch_0001/actual_output.txt

@@ -0,0 +1,10 @@
+Successfully compiled to: /var/folders/6r/tsfytt4x6s1cl4_t14c961040000gn/T/dogfood_test_23f0dbc765dd4156bf5a05a80d70d30d.exe
+
+=== Running Program ===
+
+Rectangle
+15
+16
+Circle
+50.24
+25.12

dogfood_output/issues/20260118_131748_output_mismatch_0001/expected_output.txt

@@ -0,0 +1,6 @@
+Rectangle
+15.0
+16.0
+Circle
+50.24
+25.12

dogfood_output/issues/20260118_131748_output_mismatch_0001/metadata.json

@@ -0,0 +1,18 @@
+{
+  "issue_type": "output_mismatch",
+  "timestamp": "2026-01-18T13:17:31.225175",
+  "generated_code": "# Test virtual and override methods with a simple shape hierarchy\n\n@abstract\nclass Shape:\n    name: str\n\n    def __init__(self, name: str):\n        self.name = name\n\n    @virtual\n    def area(self) -> float:\n        return 0.0\n\n    @virtual\n    def perimeter(self) -> float:\n        return 0.0\n\n    def describe(self) -> None:\n        print(self.name)\n        print(self.area())\n        print(self.perimeter())\n\nclass Rectangle(Shape):\n    width: float\n    height: float\n\n    def __init__(self, width: float, height: float):\n        super().__init__(\"Rectangle\")\n        self.width = width\n        self.height = height\n\n    @override\n    def area(self) -> float:\n        return self.width * self.height\n\n    @override\n    def perimeter(self) -> float:\n        return 2.0 * (self.width + self.height)\n\nclass Circle(Shape):\n    radius: float\n\n    def __init__(self, radius: float):\n        super().__init__(\"Circle\")\n        self.radius = radius\n\n    @override\n    def area(self) -> float:\n        return 3.14 * self.radius * self.radius\n\n    @override\n    def perimeter(self) -> float:\n        return 2.0 * 3.14 * self.radius\n\nrect: Rectangle = Rectangle(5.0, 3.0)\nrect.describe()\n\ncirc: Circle = Circle(4.0)\ncirc.describe()\n\n# EXPECTED OUTPUT:\n# Rectangle\n# 15.0\n# 16.0\n# Circle\n# 50.24\n# 25.12",
+  "expected_output": "Rectangle\n15.0\n16.0\nCircle\n50.24\n25.12\n",
+  "actual_output": "Successfully compiled to: /var/folders/6r/tsfytt4x6s1cl4_t14c961040000gn/T/dogfood_test_23f0dbc765dd4156bf5a05a80d70d30d.exe\n\n=== Running Program ===\n\nRectangle\n15\n16\nCircle\n50.24\n25.12",
+  "error_message": null,
+  "compiler_output": null,
+  "generated_cs": null,
+  "validation_result": "```\nVALID\nThe code uses only features from phases 0.1.0-0.1.10.\n```\n\n**Feature breakdown:**\n\n- **Classes (0.1.6)**: `Shape`, `Rectangle`, `Circle` with fields and methods\n- **Inheritance (0.1.7)**: `Rectangle(Shape)`, `Circle(Shape)`\n- **Abstract classes (0.1.7)**: `@abstract` decorator on `Shape`\n- **Virtual methods (0.1.7)**: `@virtual` on `area()` and `perimeter()`\n- **Override methods (0.1.7)**: `@override` on child class methods\n- **Constructor (0.1.6)**: `__init__` methods\n- **Super calls (0.1.7)**: `super().__init__(\"Rectangle\")`, `super().__init__(\"Circle\")`\n- **Instance methods (0.1.6)**: `describe()`, `area()`, `perimeter()`\n- **Fields (0.1.6)**: `name`, `width`, `height`, `radius`\n- **Primitive types (0.1.3)**: `str`, `float`, `None` (void return)\n- **Variables (0.1.3)**: `rect: Rectangle = Rectangle(5.0, 3.0)`\n- **Built-ins**: `print()` with single arguments\n- **Literals**: String literals (`\"Rectangle\"`, `\"Circle\"`), float literals (`5.0`, `3.0`, `3.14`, etc.)\n- **Operators (0.1.3)**: `*`, `+`, arithmetic operations\n- **Return statements (0.1.5)**: `return` with values\n\nAll features are within the allowed phases 0.1.0-0.1.10.\n",
+  "feature_focus": "virtual_override",
+  "complexity": "medium",
+  "backend_used": "claude",
+  "generation_duration": 5.067548036575317,
+  "compilation_duration": null,
+  "execution_duration": 1.3034591674804688,
+  "source_files": null
+}