fix: handle OperationDefinition object in Schemathesis 4.x response validation (#18)

* fix: remove method from kwargs and mark tests as ERROR on exceptions

- Remove 'method' from kwargs before passing to auth.request() to fix 'got multiple values' error
- Set test status to ERROR when exceptions occur during test execution
- Fixes issue where all 190 tests were failing but showing as passed

* fix: remove url parameter from kwargs to prevent duplication

The case.as_transport_kwargs() method returns a dictionary that includes
both 'method' and 'url' keys. We already fixed the 'method' duplication
in the previous commit, but 'url' was also causing the same issue.

When we pass path as a positional argument to auth.request(), which then
passes it to httpx.Client.request() as the 'url' parameter, having 'url'
also in **kwargs causes 'got multiple values for argument url' error.

This fix removes both 'method' and 'url' from kwargs before passing to
auth.request() to prevent parameter duplication.

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>

* fix: handle OperationDefinition object in Schemathesis 4.x response validation

In Schemathesis 4.x, operation.definition is an OperationDefinition object,
not a dictionary. The code was calling .get() on it which caused AttributeError.

This fix makes _check_response() defensive by:
1. Checking if definition is a dict or object
2. Accessing responses as dict.get() or object.responses
3. Wrapping in try-except to handle unexpected structures gracefully

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>

Author: robinmordasiewicz

scripts/utils/schemathesis_runner.py

@@ -297,24 +297,36 @@ def _check_response(
         status_code = str(response.status_code)
 
         # Get expected response schema
-        operation = case.operation
-        responses = operation.definition.get("responses", {})
-
-        if status_code not in responses:
-            # Check for default response
-            if "default" not in responses:
-                # Unexpected status code - potential discrepancy
-                if response.status_code >= 400:
-                    return Discrepancy(
-                        path=case.path,
-                        property_name="response",
-                        constraint_type="status_code",
-                        discrepancy_type=DiscrepancyType.CONSTRAINT_MISMATCH,
-                        spec_value=list(responses.keys()),
-                        api_behavior=status_code,
-                        test_values=[self._case_to_dict(case)],
-                        recommendation=f"Add {status_code} to response definitions",
-                    )
+        try:
+            operation = case.operation
+            # In Schemathesis 4.x, definition might be an object or dict
+            definition = operation.definition
+            if isinstance(definition, dict):
+                responses = definition.get("responses", {})
+            elif hasattr(definition, "responses"):
+                responses = definition.responses
+            else:
+                # Can't validate - skip check
+                return None
+
+            if status_code not in responses:
+                # Check for default response
+                if "default" not in responses:
+                    # Unexpected status code - potential discrepancy
+                    if response.status_code >= 400:
+                        return Discrepancy(
+                            path=case.path,
+                            property_name="response",
+                            constraint_type="status_code",
+                            discrepancy_type=DiscrepancyType.CONSTRAINT_MISMATCH,
+                            spec_value=list(responses.keys()),
+                            api_behavior=status_code,
+                            test_values=[self._case_to_dict(case)],
+                            recommendation=f"Add {status_code} to response definitions",
+                        )
+        except Exception:
+            # If we can't get the response schema, skip validation
+            return None
 
         return None