Skip to content

Integrate harness.py functionality into codegen-on-oss package #14

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
codegen-sh wants to merge 3 commits into from
Closed

Integrate harness.py functionality into codegen-on-oss package #14

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
66cd331
Integrate harness.py functionality into codegen-on-oss package
codegen-sh[bot] May 1, 2025
dd9b5d0
Fix linting and formatting issues in codegen-on-oss package
codegen-sh[bot] May 1, 2025
18a0737
Fix linting issues in server.py and context_snapshot.py
codegen-sh[bot] May 1, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
94 changes: 54 additions & 40 deletions ANALYSIS_VIEW_MOCKUP.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -99,7 +99,7 @@ ISSUES: 172

## 5. Issues Categorized

```
````
------------------------------------------
Unused Imports: 134 (7.1%) / 1,876
List Filenames and imports:
Expand Down Expand Up @@ -138,7 +138,7 @@ Location and codeblocks:
else:
result[key] = value
return result
```
````

2. src/core/processor.py (lines 156-172) and src/api/handlers.py (lines 78-94)
```python
Expand All @@ -151,73 +151,87 @@ Location and codeblocks:
raise ValueError(f"Missing required field: {field}")
return True
```
------------

______________________________________________________________________

Issues with Function Call in/out points: 72
(From Call site tracking and Function call relationships)

- src/core/processor.py/process_data - Called with incorrect parameter types in 5 locations
- src/utils/validator.py/validate_input - Missing required parameters in 3 locations
- src/api/routes.py/register_routes - Incorrect return value handling in 4 locations
- src/models/user.py/User.from_dict - Passing non-dict values in 2 locations
------------

______________________________________________________________________

Input/output parameter analysis
Valid 1726 parameters
Issues 11 parameters:

1. /src/core/processor.py/Processor/process_data/options - Type mismatch (expected Dict, received List)
2. /src/api/routes.py/create_user/user_data - Missing validation for required fields
3. /src/utils/formatter.py/format_output/data - Null value passed without null check
4. /src/models/transaction.py/Transaction/validate/amount - Negative values not handled
5. /src/core/analyzer.py/analyze_code/filepath - Non-existent file paths not handled
------------
1. /src/api/routes.py/create_user/user_data - Missing validation for required fields
1. /src/utils/formatter.py/format_output/data - Null value passed without null check
1. /src/models/transaction.py/Transaction/validate/amount - Negative values not handled
1. /src/core/analyzer.py/analyze_code/filepath - Non-existent file paths not handled

______________________________________________________________________

Interface implementation verification:
Valid: 71 components
Issues: 6 components:

1. src/models/user.tsx - UserComponent doesn't implement all required UserProps
2. src/components/form.tsx - FormInput missing required onChange handler
3. src/views/dashboard.tsx - DashboardView implements deprecated IDashboard interface
4. src/api/client.ts - ApiClient missing required error handling methods
5. src/utils/formatter.tsx - DataFormatter missing required format method
6. src/components/table.tsx - TableComponent not implementing required sorting functionality
1. src/components/form.tsx - FormInput missing required onChange handler
1. src/views/dashboard.tsx - DashboardView implements deprecated IDashboard interface
1. src/api/client.ts - ApiClient missing required error handling methods
1. src/utils/formatter.tsx - DataFormatter missing required format method
1. src/components/table.tsx - TableComponent not implementing required sorting functionality

```

## 6. Visualization Types

```

ALL VISUALIZATION TYPES
Selection 1- type (Example - hierarchy, dependency)
after selecting 1-> 2nd selection is corresponding parameter (example -call hierarchy, symbol hierarchy, Inheritance hierarchy)
Again- corresponding parameter selection (if applicable)- (For example - codefile / class / method)

Hierarchy Visualizations:
- Call hierarchy visualization
- By file: src/core/processor.py
- By class: Processor
- By method: process_data
- Symbol hierarchy visualization
- By module: src/core
- By file: src/core/processor.py
- By class: Processor
- Inheritance hierarchy visualization
- By class: BaseProcessor

- Call hierarchy visualization
- By file: src/core/processor.py
- By class: Processor
- By method: process_data
- Symbol hierarchy visualization
- By module: src/core
- By file: src/core/processor.py
- By class: Processor
- Inheritance hierarchy visualization
- By class: BaseProcessor

Dependency Visualizations:
- Module dependency visualization
- By module: src/core
- By file: src/core/processor.py
- Symbol dependency visualization
- By class: Processor
- By function: process_data

- Module dependency visualization
- By module: src/core
- By file: src/core/processor.py
- Symbol dependency visualization
- By class: Processor
- By function: process_data

Flow Visualizations:
- Function call visualization
- By function: process_data
- By class method: Processor.validate_input
- Package structure visualization
- Full project
- By module: src/core
- Variable usage tracking
- By variable: config
- By class attribute: Processor.options

- Function call visualization
- By function: process_data
- By class method: Processor.validate_input
- Package structure visualization
- Full project
- By module: src/core
- Variable usage tracking
- By variable: config
- By class attribute: Processor.options

```

## Suggested Views
Expand Down Expand Up @@ -279,4 +293,4 @@ For the Full Specific Issues View, I recommend a detailed, filterable list of al
- Specific, actionable steps to resolve each issue
- Code examples of proper implementation
- Links to relevant documentation or best practices

```
11 changes: 5 additions & 6 deletions codegen-examples/examples/snapshot_event_handler/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Event Handler with codebase snapshotting

This project is designed to using Modal snapshotting to provide parsed codebase instances with minimal latency, make it more manageable to write event based handlers.
This project is designed to using Modal snapshotting to provide parsed codebase instances with minimal latency, make it more manageable to write event based handlers.
Copy link

@sourcery-ai sourcery-ai bot May 1, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

issue (typo): Minor grammatical error.

Change “designed to using” to “designed to use.”

Suggested change
This project is designed to using Modal snapshotting to provide parsed codebase instances with minimal latency, make it more manageable to write event based handlers.
This project is designed to use Modal snapshotting to provide parsed codebase instances with minimal latency, make it more manageable to write event based handlers.

Copy link

@sourcery-ai sourcery-ai bot May 1, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

issue (typo): Grammatical error in sentence.

Replace “designed to using” with “designed to use” or “designed for using.”

Suggested implementation:

This project is designed to use Modal snapshotting to provide parsed codebase instances with minimal latency, making it more manageable to write event based handlers.

The change updates the wording from "designed to using" to "designed to use" and also adjusts "make" to "making" for grammatical consistency.


Follow the instructions below to set up and deploy the application.

Expand All @@ -9,7 +9,7 @@ Follow the instructions below to set up and deploy the application.
Before you begin, ensure you have the following installed and configured:

1. **uv**: A tool for managing virtual environments and syncing dependencies.
2. **Modal**: Ensure you have Modal configured on your system.
1. **Modal**: Ensure you have Modal configured on your system.
Copy link

@coderabbitai coderabbitai bot May 1, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🛠️ Refactor suggestion

List numbering inconsistency.

The numbering of list items has been changed from sequential numbering to all items starting with "1." This creates confusion for readers. Either maintain sequential numbering (1, 2, 3) if these are steps in a single list, or use proper Markdown formatting with separate lists.

1. **uv**: A tool for managing virtual environments and syncing dependencies.
-1. **Modal**: Ensure you have Modal configured on your system.
+2. **Modal**: Ensure you have Modal configured on your system.

[...]

-1. **Sync Dependencies**
+2. **Sync Dependencies**

[...]

-1. **Deploy to Modal**
+3. **Deploy to Modal**

Also applies to: 26-26, 34-34

🤖 Prompt for AI Agents (early access) 
In codegen-examples/examples/snapshot_event_handler/README.md at lines 12, 26, and 34, the list numbering is inconsistent because all items start with "1." instead of sequential numbers. Fix this by updating the Markdown lists to use proper sequential numbering (1, 2, 3, etc.) if these are steps in a single list, or separate them into distinct lists with correct Markdown formatting to avoid confusion.


## Setup Instructions

Expand All @@ -23,15 +23,15 @@ Before you begin, ensure you have the following installed and configured:
source ./venv/bin/activate
```

2. **Sync Dependencies**
1. **Sync Dependencies**

Sync the project dependencies using `uv`:

```bash
uv sync
```

3. **Deploy to Modal**
1. **Deploy to Modal**

Deploy the application to Modal by running:

Expand All @@ -48,7 +48,6 @@ Before you begin, ensure you have the following installed and configured:
- `.env.template` and `.env`: Environment variable templates and configurations.
- `pyproject.toml`: Project configuration and dependencies.


## Integration

Once deployed, you can use the deployed web_url as the webhook endpoint for your slack, linear, or github webhooks.
Once deployed, you can use the deployed web_url as the webhook endpoint for your slack, linear, or github webhooks.
16 changes: 14 additions & 2 deletions codegen-examples/examples/swebench_agent_run/local_run.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,14 @@
"metadata": {},
"outputs": [],
"source": [
"await run_eval(use_existing_preds=None, dataset=\"lite\", length=5, repo=\"django/django\", num_workers=10, model=\"claude-3-7-sonnet-latest\")"
"await run_eval(\n",
" use_existing_preds=None,\n",
" dataset=\"lite\",\n",
" length=5,\n",
" repo=\"django/django\",\n",
" num_workers=10,\n",
" model=\"claude-3-7-sonnet-latest\",\n",
")"
]
},
{
Expand Down Expand Up @@ -76,7 +83,12 @@
"source": [
"from codegen.agents.code_agent import CodeAgent\n",
"\n",
"agent = CodeAgent(codebase=codebase, tags=[\"local_test\"], model_name=\"claude-3-5-sonnet-latest\", model_provider=\"anthropic\")"
"agent = CodeAgent(\n",
" codebase=codebase,\n",
" tags=[\"local_test\"],\n",
" model_name=\"claude-3-5-sonnet-latest\",\n",
" model_provider=\"anthropic\",\n",
")"
]
},
{
Expand Down
Loading
Loading